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SHAWN POWERS 


The Cake Is Not a Lie! 


important to know that “Linux” is really 

just the kernel that powers our awesome 
computer systems. Before we get into heated 
debates about .deb and .rpm, or holy wars over 
GNOME and KDE, we never can forget that 
Linux really is just the kernel. 

Likewise, cake is just the sweet bread stuff 
that hides under the frosting. Sure, icing, candles, 
plastic superheros and burning flames are what 
make a cake into a party, but at the base of 
things, cake is just that bread stuff. This issue, we 
talk about frosted cake and discuss the wonderful 
world of decorating. (If you prefer, feel free to use 
a mashed-potato-and-gravy metaphor instead. 
| realize we're not all cake fans.) 

My first suggestion for this issue is that you 
turn to our centerfold. Granted, it's not really in 
the center (it’s on pages 62 and 63), but it is a 
two-page spread that presents a ton of popular 
distributions. Our own Justin Ryan filled in the 
abundant blanks for us, and it’s worth more than 
a cursory glance. If you like what you see, perhaps 
the next logical step would be to read Jes Fraser’s 
article discussing the history of Linux distributions. 
Jes shows the whole gamut, starting from the 
Usenet post on the MINIX newsgroup. 

What is MINIX, you ask? That's a good question. 
Bruce Byfield happily answers by discussing 
the present-day operating system that was the 
basis for Linus’ early kernel. Although certainly 
not as popular as our coveted Linux, MINIX is a 
good way to learn about our roots without the 
complications of different colored frosting—er, 
distributions. Working with MINIX, while still 
being a Linux user, might start to make you think 
about the philosophy of your operating system. 
It certainly did for Dan Sawyer, and this month, 
he discusses some of the fundamental issues 
that Linux users face. What does it mean to be 
free? Is commercialism a good or bad thing? 
Is butter cream or Dream Whip the best icing 
for cake? However you slice it, Linux is many 
different things for many different people. 

| know some of you are getting worried that 
this issue is starting to sound more like a college 


l inux is a kernel. Before | go any further, it's 
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lecture than your normal monthly dose of tech 
goodies. Fear not; we have the perfect snack 
for your geeky sweet tooth as well. Mick Bauer 
wraps up his series on OpenVPN; Dave Taylor gets 
intense with some sophisticated HTML forms, and 
Reuven M. Lerner adds more about MongoDB. 

Kyle Rankin proves that good workers are 
workers that can make computers do their work 
for them. He demonstrates making config files 
using nmap. It may sound strange, but it certainly 
will save you some grunt work and leave you 
time for other, more enjoyable things. If one 
of the things you enjoy doing is reading books, 
you'll want to read Dirk Elmendorf's article on 
library software. My wife is a librarian, and | can 
assure you that the days of the card catalog are 
over. Thankfully, Linux can step in and manage 
your books, whether you have only one shelf or 
enough books to overwhelm Mr Dewey himself. 

No matter what your favorite cake is or what 
kind of frosting you prefer, everyone needs a pan 
to bake it in—that means hardware. With Linux, 
it's hard to find a limit to what we can use as 
an installation base. Kira Scarlett talks about a 
few of the less-common architectures and some 
reasons you might want to try them out. Mike 
Diehl reviews the Pogoplug device. It’s tiny, cute, 
and it runs Linux. There are so many devices that 
run Linux, sometimes it’s hard to choose a platform. 
Bill Childers and Kyle Rankin don’t seem to have 
that problem, however, and this month they set 
out to prove why their cell-phone choice is best. 
As usual, I'm going to try to stay out of it. 

So this month, whether you favor apt-get 
over emerge, or like fedoras instead of lizards, 
we all can agree to like cake—and the Linux 
kernel. Hopefully, you'll learn a few things, but 
more important, we hope you're inspired to try 
different distributions. Because really, it’s hard 
to pick bad cake.m 


Shawn Powers is the Associate Editor for Linux Journal. He's also the Gadget 
Guy for LinuxJournal.com, and he has an interesting collection of vintage 
Garfield coffee mugs. Don’t let his silly hairdo fool you, he’s a pretty ordinary 
guy and can be reached via e-mail at shawn@linuxjournal.com. Or, swing 
by the #linuxjournal IRC channel on Freenode.net. 


Servers BP olReCY 


HORE F PRODUCTS. BETTER SERVICE, GUARANTEED. 


PLUS 


SDR-S$1343-T04 


1U INTEL® XEON® PROCESSORS 5500 SERIES 
SERVER W/ 4X 3.5" HOT-SWAP SATA DRIVE BAYS 


sro 1U Rackmount Server with HE 560W Power 


ermicro Server Board w/Intel® 
t up to Dual Intel® 550 
e, with QPI up to 6.4 GT/s 
port up to 96GB DDR3 1333/ 1066/ 800MHz ECC 
Reg. DIMM 
¢ 4x 3.5" Hot-swap 


* Intel® 82576 Dua 


520 Chipset 


ries Xeon® Quad/ 


SATA Drive Bays 
rt Gigabit Ethernet Controller 


SDR-S4309-T08 


TOWER/4U INTEL® XEON® PROCESSORS 5500 
SERIES SERVER W/ 8 X 3.5" HOT-SWAP DRIVES 
TRAYS 


* Supermicro Tower 800W'Redundant'Power Supply 

* Supermicro Server Board w/ Dual Intel® 5520 eh 6 

¢ Su Dual Intel® 5500 series Xeon® Quad/Dual 

ith QPI up to 6.4 GT/s 

¢ Support up to 192GB DDR3 1333/ 1066/ 800MHz ECC 
Reg DIMM 

* 24x 3.5" Hot-swap SATA Drive Bay 

* Intel® 82576 Dual-pc 


rt Gigabit Ethernet Controller 


GO STRAIGHT TO THE SOURCE! 
1.877.727.7887 | www.ServersDirect.com 


BUSINESS TO BE MORE PRODUCTIVE? 


owing busir ess. 


HIGH EFFICIEN ¥ POW ER & HIGH ST 
$4314-136 -— 


ri SE- LEVEL HIGH CAPACITY STORAGE 


+ Maximum 3.5" hot-swap ‘drives density 


- 86x (24 front +"12.rear) Hard Drive Bays 


- E1: Expander supports SAS 


+ Redundant (1+1) 1400W Gold:Level power spp with | 


2MBus functio 


+ Redundant, Hot-pluggable cooling system, Power sees Hot-swap dr 
+ Support up to 192GB DDR3 1333/ 1066/ 800MHz ECC Reg DIMM 
+ Intel® 82576 Dual-Port Gigabit Ethernet Controller 


80 


PLUS 


SDR-S2318-T06 


2U INTEL® XEON® PROCESSORS 5500 SERIES 
SERVER W/ 8X 3.5" HOT-SWAP SAS/SATA BAYS 


¢ Supermicro 2U Rackmount Server w/650W HE Power 
ermicro Server Board w/Intel® 
up to Dual Intel® 5500 se 
2, with QPI up T 
ip to 192GB DDR 1333/ 1066 / 800MHz ECC 
Reg DIMM 
* 6x 3.5" Ho 
* Dual Intel® 8: 


2p SAS / SATA Drive B 
4L Gigabit Ethern 


TOWER/4U INTEL® XEON® PROCESSORS 5500 
SERIES SERVER W/ 8X 3.5" HOT-SWAP SATA BAYS 
(SUPPORT UP TO 4 DOUBLE-WIDTH GPU) 
¢ 4U Rackmountable / Tower with 1400W Gold Level 

Redundant Power Supply Optional Rackmount Kit 
Supermicr6 Server Board w/ Dual Intel® Dual Chipset ICH10R 
»s Xeon® Quad/Dual-Core 


¢ Support up to Dual Intel® 5500 serie 
with QPI up to 6.4 GT/s 
192GB DDR3 1 
wap Drives Trays Supr 
* Intel® Dual 82574L Gigabit Ethernet 
* 4x NVIDIA Tesla C1060 GPU Cards 


1333/ 1066 / 800MHz ECC Reg 
ts up to 6 SATA Drives 


* Support up to 


° 8x 3.5" Hot 


SERVERS DIRECT CAN HELP YOU CONFIGURE YOUR NEXT HIGH PERFORMANCE SERVER SYSTEM - CALL US TODAY! 


Our flexible on-line products configurator allows you to source a custom solution, or call and our product 
experts are standing by to help you to assemble systems that require a little extra. Servers Direct - your direct 
source for scalable, cost effective solutions. 


1.877.727.7886 / www.ServersDirect.com 


Intel, Intel logo, Intel Inside, Intel Inisde logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, Pentium, 


and Pentium Ill Xeon are trademarks of Intel Corporation or it's subsidiaries in the United States and other countries. 


DIMM 


SDR-S3308-T08 


3U INTEL® XEON® PROCESSORS 5500 SERIES 
SERVER W/ 8 X 3.5" HOT-SWAP DRIVES TRAYS 


¢ Supermicro 3U Rackmount Server w/650W HE Power Supply 
¢ Supermicro Server Board 9520 Cr 


t up to Dual Intel® 5500 series Xeon® Quad/Dual-Core 


up to 192GB DDR3 1333/ 1066 / 800MHz ECC 


¢ Support 
Reg DIMM 
¢ 8x 3.5™ Hot-swap Drives Trays 6 x SATA Hard Drives 


Supported 
¢ Dual Intel® 82574L Gigabit Ethernet 


SDB-S7002-T00 


9U INTEL® XEON® PROCESSORS 5500 SERIES 
SERVER W/ 50X HOT-SWAP SATA II / SAS BAYS 


* Supermicro SBE*714D-D28 Enclosure chassis with two 
1400W power supplies, Up to 
sed'blades 


2ment modules comes s 


14 hot-plug processor blades 


tandard with each 


enclosure 


* One hot-plug manac 
and IPMI 2.0 func 
* Support one hot-plug Gigabit Ethernet switeh 


ement modules’ providing remote KVM 


Pass - Through Module 


Powerful. 
Intelligent. 


letters 


NoSQL | OpenVPN | Mongoose | Selenium | jsormdb | Android 
Use 
for a Simple 
Web Server 
Take Rich 
internet 
Apps to the 
Next Level 
Since azine of the Linux Community with 


Flash 
Application 


Development 


Fx @) & 


Test Web 
Apps with 


Interview— 
Rich Hickey, 
Creator of 


Point/Counterpoint/Point 

In the March 2010 Point/Counterpoint 
column, Kyle Rankin pretends that he 
has to use --prefix to install apache to 
/usr/local instead of /usr. 


Well, he surely hasn't used any 
/configure script in the past 15 years, 
because it goes to /usr/local by default, 
and apachez2 uses /usr/local/apache2 
as a default prefix. 


One less “point” in favor of Kyle, heh? 


Arnaud Launay 


Kyle Rankin replies: You are right. When 
Bill and | do the Point/Counterpoint 
column, it’s all off-the-cuff responses, 

so | talked about --prefix with ./configure 
while | was really thinking about --prefix 
in building and installing RPMs. | didn’t 
realize the default install location for 
./configure was /usr/local (although in 
my opinion, that makes an even stronger 
argument for /usr/local: it’s the default). 
To be honest, although | compiled many 
programs back when | started using Linux 
(it was almost a requirement to compile 
the kernel at the very least), | rarely com- 
pile anything anymore, especially when 
it’s going to be used in production. | 
think the moment you go down that 
road, especially when you have a large 


environment, you lose all the testing ben- 
efits you get with distribution packages, 
and you become a QA department of 
one. Now, | know that many system 
administrators still like to do everything 
by hand, but to me, the risks and mainte- 
nance headaches of that far outweigh 
any benefits. It may be okay with one or 
two servers, but in my opinion, it doesn’t 
scale. Thanks for the comment. 


Simplicity and Support 

Mick Bauer's VPN series is long overdue 
[see Mick's Paranoid Penguin columns 
starting with the February 2010 issue 
through this current issue]. But in 
practice, few medium-to-large companies 
are going to deploy an OpenVPN server. 
Their corporate management has at least 
two requirements it can’t meet: simplicity 
and support. To them, simplicity means a 
proprietary appliance from a name-brand 
vendor—they distrust software running 
on *nix in their infrastructure, never 
mind that the black-box appliance is 
probably just software running on 
embedded BSD or Linux. And, support 

is a euphemism for “somebody to sue”. 


This leaves those of us who need to 
make VPN connections to multiple 
clients/partners in the unenviable position 
of being stuck with one or more com- 
puters with a half-dozen incompatible 
proprietary VPN clients installed (most 

of which work only on MS Windows). 


How about an article on making the 
OpenVPN client, and/or other open- 
source VPN clients, interoperate with 
servers from some of the popular VPN 
vendors, such as Cisco, Juniper, Nortel 
and so on, and the issues involved 
in connecting and authenticating to 
proprietary VPN servers? 


Tom Uffner 


Mick Bauer replies: This particular 
series of articles was targeted at 
home/small-office/medium-office 
administrators; it was no coincidence 
that all my examples talked about 
connecting back to my house or that / 
showed a server configuration allowing 
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only two concurrent connections. But by 
all means, you're correct, an article on 
connecting Linux clients to big commercial 
VPN concentrators would be useful. |’I/ 
consider that for a future column! 


In the meantime, | can offer a quick 
hint. Whereas in client mode, OpenVPN 
can connect only to OpenVPN server 
processes, the free utility vpnc can 
connect to Cisco and Juniper/NetScreen 
VPN servers. Thanks for writing! 


Making Linux Known to 
Computer Haters 

Microsoft spends hundreds of millions 
of dollars on advertising each year, 
reaching those in the community who 
own PCs but spend very little time with 
them. Microsoft's goal is to reinforce 
that Microsoft and Windows are what 
everyone uses on their PCs and that’s 
just the way it is. | believe if a survey 
was taken world-wide on what operat- 
ing systems were available to home 
PC users, a large number would say 
Windows and Mac. So, what's this letter 
all about? It's about finding ways with- 
out spending money to get Linux out to 
those who have no interest in operating 
systems in general. How (like Microsoft 
and Windows) do we reach people and 
make them aware of the existence of 
Linux without spending money? 


| propose you write a article on the 
“Best Free Creative Ideas” that pro- 
mote Linux. Here’s mine. Get your 
readers to leave old copies of Linux 
Journal in doctors’ waiting rooms (and 
similar places) where you have a captive 
audience looking for something to 
read. Maybe run a poll for the best 
ideas from your readers. 


John Van Gaans 
John, that’s a great idea! Perhaps 


the Web site is a good place to get 
feedback.—Ed. 


Send Letters to the Editor at 


www.linuxjournal.com/contact 


We Speak Your Language 


if (Sordered_online && Scoupon_code == ‘linux 
journal') 

af 

Sserver_discount = Sserver_price * -]5 


* LUZ off for coupon code “*linuxjournal"’ 
} 


VWVV VV VM 


Choose the dedicated and managed hosting provider 
that understands you- 


1-677-999-2701 
www-codero-com 


LETTERS 


This is a great magazine, and | have 
learned a great deal from it. | can safely 
say that with the help of this maga- 
zine, you made this 14-year-old learn a 
lot more about Linux, open source and 
computer management in general. 
Gotta say, mad props to you guys— 
keep the good news going. | look 
forward to reading the latest issue! 


Aw shucks, Alex. It thrills me that a 
14-year-old reads Linux Journal! / put 
my monthly issues in our local school 
library, but they don’t get read nearly 
as much as Id like. The rest of the edi- 
torial staff isn’t very keen on my idea 
of including a centerfold each month 
with hot new hardware. It’s good to 
hear that even without such eye candy, 
the magazine is still appreciated.—Ed. 


On my PC running Debian GNU/Linux 
| use dwm (dwm.suckless.org) as my 
X window manager, and | like it very 
much. Now, on Wikipedia, there is an 
article about dwm (en.wikipedia.org/ 
wiki/Dwm), but there is a discussion 
going on about deleting the dwm 
article (en.wikipedia.org/wiki/ 
Wikipedia:Articles_for_deletion/ 
Dwm). One of the reasons is “This 
article needs references that appear 
in reliable third-party publications.” 


So, | was wondering if Linux Journal 
could publish an article about this 


small and powerful window manager. 


Thanks for bringing this to our 
attention. We'll take a look at it, 
and see if it inspires anyone on 
staff to write about it.—Ed. 


Have a photo you'd like to share with LJ readers? Send your submission to 
publisher@linuxjournal.com. If we run yours in the magazine, we'll send 


you a free T-shirt. 


a Aa 


McAfee enterprise products run on McAfee Linux. McAfee Linux team members must 
dress in their daily uniform to show their support for the product. This is me standing 
in front of the Alpharetta, Georgia, office. All hail Tux! Submitted by John Masinter. 
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At Your Service 


The new Intel® Xeon® processor 5600 
series increases performance, cuts 
operating costs, and helps deliver ROI. 


That's intelligent performance! Check Powerful. 
out the new intelligent features of the Intelligent. 
Xeon 5600 at intel.com/itcenter. a =a 


Servers from iXsystems feature the Intel® Xeon® processor 5600 series. 


Enterprise Servers 
for Open Source 
www.iXsystems.com 


800-820-BSDi ‘ 

¥ - i A 
Cleverly disguised as any other 2U server, the Gemini? : Hl 
houses 4 highly efficient, extremely powerful RAID 5 Orion Il 
SAN SERS, ¢ Intel® Xeon® processor 5600 series e Intel® Xeon® processor 5600 series 
The Orion Il 4U Storage Solution boasts energy-efficient e 4 Nodes in a 2U Form Factor ¢ Up to 72TB in 4U 
technology and maximum, high-density storage capacity, 
creating a 4U powerhouse with superior cooling, ¢ Up to 192GB DDR3 RAM Per Node © 36 x 3.5 Hot-Swap SAS/SATA HDDs 

© 3x 3.5" SAS/SATA Drives/Node © 1400W Gold Level Power Supply 


Starting at $3599 Starting at $3199 
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diff -u 


WHAT’S NEW IN KERNEL DEVELOPMENT 


Paul E. McKenney has worked up a 
patch to include a more precise version 
number in the config data, so if you're 
running a kernel built from a git 
repository, you'll be able to identify 
the source tree precisely, even if it’s 
in between officially released versions. 
In this case, the version number will 
look something like 2.6.33-01836- 
g90a6501. Isn't it beautiful? His code 
actually went through numerous revi- 
sions to make sure it derived the version 
number in a safe way that wouldn't 
cause other scripts to choke and to give 
users the option of setting environment 
variables to control whether full version 
information should be included. 

Dave Young has posted patches to 
change the patch submission documen- 
tation to list Gmail as no longer useful 
for sending patches. In the past, Gmail 
apparently could be made to send 
patches cleanly by jumping through a 
couple hoops, but now that’s no longer 
the case. Gmail converts tabs to spaces, 
automatically wraps long lines and will 


64-bit encode messages that have 
non-ASCII characters. Any one of those 
features would be enough to corrupt a 
patch file. Now, it’s possible to config- 
ure Firefox to edit the e-mail with an 
external editor, and in the past, Gmail 
would send the edited text instead of 
using its own editor. But, with the intro- 
duction of the line-wrapping feature, 
Gmail apparently wraps lines even 
when an external editor is used. The 
documentation used to explain the 
workaround involving the external editor, 
but Dave's patch now simply lists the 
various issues and states that Gmail 
shouldn't be used for sending patches 
to the linux-kernel mailing list. 

Eric W. Biederman has changed 
the way /dev/console is created. The 
old way was to wait until the filesystem 
containing the /dev directory had been 
mounted and then mount /dev/console 
there. The problem with that is if you 
ever want to unmount the filesystem, 
you can run into problems if /dev/console 
is still open. Eric’s patch mounts 


/dev/console as part of rootfs—still 
in the same location, still called 
/dev/console, but just as part of rootfs 
instead of whatever filesystem you 
choose to mount for your running 
system. Very, very few power users 
may have to adjust the way they do 
things slightly as a result of this patch. 
Everyone else should notice nothing 
at all, or they may notice in some 
situations, certain problems that used 
to crop up don’t anymore. 

Christine Caulfield has marked 
herself as no longer maintaining the 
DECnet networking layer and has 
marked that code as orphaned instead 
of maintained. With the decnet mailing 
list totally silent, her theory is that the 
only users are running older kernels 
and are happy with it as is. The DECnet 
networking protocols originally were 
used in the 1970s to connect PDP-11s. 
They were published as open standards, 
paving the way for Linux's DECnet 
implementation decades later. 

—ZACK BROWN 


Create BillyBobBuntu with Reconstructor 


One glance at DistroWatch will prove that Linux users like 
to roll their own distributions. Heck, there's even a distri- 
bution called Linux From Scratch, which you'd 
think would just be called Linux! If you have 
been itching to roll your own distribution 


but feared it was too complicated, 


Reconstructor (www.reconstructor.org) 


might be exactly what you need. 

I've written about Reconstructor 
before on the Linux Journal Web site 
(www.linuxjournal.com/content/ 


reconstructor-when-you-lose-your-restore-cd), 


and more recently, Ross Larson wrote a follow-up on how 


14 | june 2010 www.linuxjournal.com 


the project has progressed (www.linuxjournal.com/content/ 
howto-customized-live-dvds-reconstructors-web-ui). 
One interesting new feature is that you can 
build your own distribution from a 
Web-based distro builder. Surfing over to 
build.reconstructor.org (and creating 
an account) allows you to build a 
custom Linux distribution and then 
download it. 
| do have one request: please don’t 
start a new Linux distribution to compete 
with all the others. We already have plenty! 


—SHAWN POWERS 


NON-LINUX FOSS 
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Whether you think making 
each program have its own 
installer is a bug or a feature, 
in the Windows world, it’s 
the norm. So, if you're 
porting open-source code to 
Windows, at some point, you 
have to think about creating 
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to call DLL tTunetions at runtime trom 


[Setup] 


Program 
e=My Program version 1.5 
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miyProg.exc"s an installer. 
—— Inno Setup is a free and 
fewer open-source installer for 
Pescicen nostra ken SOR Windows programs. It’s been 
scFion Ressagesow (nina: Integer? ipteet, integrons seroma wey — arqund since 1997 and is 
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written in Delphi Pascal. Inno 
Setup is driven by a script that 
you provide, allowing Inno 


Inno Setup Install Script 


Setup to create an installer for your program. The script is much like an INI file. 
You provide simple name/value pairs that drive the creation of the installer. For 
more complex scenarios, Inno Setup contains its own built-in Pascal compiler for 
creating real “code” sections in the script. 

Inno Setup has a long list of supported features: support for 64-bit applications, 
customizable setup types, integrated uncompressing of installed files, creation 
of shortcuts, creation of registry entries, running programs before/during/after 
the install, password protection, digital signing and much more. See the Web 
site (www.jrsoftware.org/isinfo.php) for more information. 

Inno Setup runs on all modern versions of Windows. It creates an uninstaller as 
well as an installer and packages it all up in a single EXE for easy distribution. At the 
time of this writing, Inno Setup is at version 5.3.8, released February 18, 2010. 


—MITCH FRAZIER 


Save Your Favorite Articles 


Did you know you can save your favorite LinuxJournal.com articles to 
reference later? Just click “Mark this as a favorite” at the bottom of 
any post, and you'll see it on your user profile. When you click your 
favorites tab, you can search your favorites for easy reference. Now, 
you can keep track of all the useful articles you come across on 
LinuxJournal.com in a sort of recipe box. Visit any author or reader 
profiles to see their favorite articles as well. We hope this makes it 
easier for you to recall specific info on the site. I’d love to hear how 
this feature is working for you, so feel free to drop me a line at 
webmistress@linuxjournal.com. See you on-line! 


—KATHERINE DRUCKMAN 
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June 2010 


1. Millions of developers in the world: 15.2 


2. Number of lines of code produced per developer 
per day: 10 


. Millions of lines of code produced per year by all 
developers: 31,616.0 


. Millions of lines of code produced per minute by all 
developers: 0.32 


. Millions of lines of code in kernel version 2.6.32: 
12.99 


. Minutes required to rewrite the Linux kernel if all 
developers pitched in: 41 


. Millions of lines of code in the average Linux distro: 
204.50 


. Hours required to rewrite the average Linux distro if 
all developers pitched in: 10.6 


. Number of the top 10 fastest computers in the 
world that run Linux: 10 


10. Number of the top 10 fastest computers in the 
world that run UNIX: 0 


11. Number of the top 10 fastest computers in the 
world that run Microsoft Windows: O 


12. Number of the top 10 fastest computers in the 
world built by Cray: 2 


13. Number of the top 10 fastest computers in the 
world built by IBM: 4 


14. Number of the top 10 fastest computers in the 
world built by Sun: 2 


15. Number of the top 10 fastest computers in the 
world built by SGI: 1 


16. Number of the top 10 fastest computers in the 
world built by NUDT (China): 1 


17. Teraflop speed of world’s fastest computer (Cray 
Jaguar at ORNL): 1,750 


18. Terabytes of memory in the world’s fastest computer: 
362 


19. Petabytes of disk storage in the world’s fastest 
computer: 10 


20. Number of Opteron processor cores in the fastest 
computer in the world: 224,256 


Sources: 7; Evans Data! 2: Frederick P. Brooks in “The 
Mythical Man Month” | 3: #1 * #2 * 208 (208 working 
days/year) | 4: #1 * #2/ 8/60 (8-hour workday) | 

5: www.h-online.com | 6: #5/#4 1 7: Linux Foundation | 
8: #6 * #4/601 9-16: TOP500! 17-20: www.ornl.gov 
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Maintaining Your System from the Command Line 


Many Linux distributions use some form of packaging system to 
organize applications installed on a system. A formal packaging 
system lets you install, remove and, in general, maintain your software 
in a controlled and coherent way. The three main packaging systems 
that most distributions currently use are the Debian deb package, the 
Red Hat rpm package and the Slackware pkg package. They all have 
graphical utilities to interact with the packaging system, but what if 
you want to deal with the system on the command line? What if 
you're running a server or accessing a distant machine through SSH 
and don’t want to deal with the overhead of X11? Let's look at how 
to do this for Debian-based systems. 

First, you probably will want to install some software. The preferred 
way to do this is with the apt-get utility. apt-get is aware of the chain of 
dependencies between packages. If you want to install stellarium, simply 
run apt-get install stellarium, which downloads the relevant 
package file and all of its dependencies from a repository. What if you 
don't know the exact package name? Use the dpkg-query utility to query 
the package management system. So, if you know the package name 
has “kde” in it, you can list all the matching packages with dpkg-query 
-1 "*kde*". Remember, quote any search strings that have an asterisk 
(*), so you don’t inadvertently make the shell try to expand them. 

This works great for software available in the given repository. 
But, what if you want something not available? If you have a 
.deb file available for download, you can download it and install 
it manually. After downloading the file, install it by running dpkg 
-i file_to_install.deb. 

dpkg works with the deb packaging system at a lower level 
than apt-get. With it, you can install, remove and maintain individual 
packages. If you have a group of packages to install, you might 
want to add the relevant repository to your list so that apt-get 
knows about it. The list of repositories is stored in the configuration 
file /etc/apt/sources.list. Each line has the form: 


deb http://us.archive.ubuntu.com/ubuntu/ karmic main restricted 


The first field tells apt-get what is available at this repository: deb 
is for binary packages and deb-src is for source packages. The second 
field is the URL to the repository (here, the Ubuntu repository). The 
third field is the repository name (in this case, the repository for 
Ubuntu’s karmic version). The last fields are the sections from which 
to install packages. This example looks at the main and restricted 
sections when trying to install applications or resolve dependencies. 

Now that you have installed some applications, you probably want to 
maintain and keep them updated, because every piece of software will 
have bugs or security issues that come to light over time. Developers 


always are releasing new versions to fix those issues and updating the 
relevant packages in the repositories. To update the list of software and 
versions on your system, run apt-get update. Once you've updated 
the list, tell apt-get to install the updates with apt-get upgrade. 
If you want a list of what is about to be upgraded, add the -u 
option: apt-get upgrade -u. 

Sometimes, when a new version for a package comes out (like 
when a distribution releases a new version), the dependencies for 
said package might change too. In such cases, a straight upgrade 
might be confused, so use apt-get dist-upgrade. This command 
tries to deal with these changes in dependencies intelligently, adding 
and removing packages as necessary. 

What if you've installed a package just to try it out and don’t want 
it anymore? Remove a package with apt-get remove stellarium. 
This removes all the files installed as part of the stellarium package, 
but it leaves any configuration files intact and also doesn’t deal with 
any extra packages installed because stellarium depended on them. If 
you want to remove a package completely, including all configuration 
files, run apt-get purge stellarium. 

Installing and removing all this software can result in space-wasting 
cruft accumulating on your system. To recover some space, run 
apt-get autoclean. This removes the package .deb files from the 
local cache for packages that no longer can be downloaded (mostly 
useless packages). If you want to clean out the local cache completely 
and recover more space, run apt-get clean. 

Although remove and purge will remove a package, what can you 
do about any dependencies installed for this package? If you run apt-get 
autoremove, you can uninstall all packages that were installed as 
dependencies for other packages and aren't needed anymore. 

Another way of finding packages that are no longer needed is 
with the deborphan utility. First, you need to install it, with apt-get 
install deborphan. (Most distributions don’t install it by default.) 
Once installed, running it with no command-line options gives a list of 
all packages in the libs and oldlibs sections that have no dependencies. 
Because no other package depends on those packages, you safely can 
use apt-get to remove or purge them. If you want to look in all sections, 
use the -a option. If you’re trying to save space, ask deborphan to print 
out the installed sizes for these orphan packages by using the -z option. 
Then, you can sort them with deborphan -z -a | sort -n, which 
gives a list of packages you can safely uninstall, sorted by installed size 
from smallest to largest. 

Each of the tools discussed above has many other options that 
you should research in the relevant man pages. Also, Red Hat-based 
systems have equivalent commands to help you manage rpm files. 

—JOEY BERNARD 


We live in a society exquisitely depen- 
dent on science and technology, in 
which hardly anyone knows anything 
about science and technology. 
—Carl Sagan 


Any science or technology 
which is sufficiently advanced 
is indistinguishable from magic. 
—Arthur C. Clarke 


Any technology that is 
distinguishable from magic is 
not sufficiently advanced. 
—Gregory Benford 


The most overlooked advantage to 
owning a computer is that if they 
foul up, there’s no law against 
whacking them around a little. 
—Porterfield 
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Microsoft once made the mistake 
of broad-brushing Linux as an 
intellectual property quagmire. 
It made Microsoft headlines, 
but few friends: lawyers didn’t 
believe it, customers didn’t want 
to hear it, and competitors dared 
it to sue. 

Years later, Microsoft still 
hasn't sued, but instead plods 
away at convincing the world, 


one patent cross-licensing agree- 
ment at a time, that everyone, 
everywhere owes it money for 
alleged violations of its IP in Linux. 
—Matt Asay, Chief Operating 
Officer at Canonical 


A year spent in artificial intelli- 
gence is enough to make one 
believe in God. 

—Alan J. Perlis 
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Dual Booting, Not Just for 
Windows Users 


Ditlix Boot Menu 


This is LJ's Distribution 
issue, and it seems fair 
to note that programs 
like GRUB aren't only 
for those of us with one 
foot in the Windows 
world. Did you know 
you can run Fedora and 
Ubuntu on the same 
machine? Did you know 
you can run Fedora 10, Fedora 12, Ubuntu 8.04, Ubuntu 9.10, Slackware and 
Linux Mint all on the same machine? 

One of the many great things about Linux is that it makes multiple installs simple! 
During the install process, carve off a hunk of hard drive, and most distributions 
happily will honor and respect your existing GRUB install. So if you can’t decide which 
distribution you want to try, install them all! (Okay, if you install 20 distributions 
on one computer, you may start to run into problems keeping them straight!) 


Billix is based on Knoppix Technology, and contains: 
Dann Small Linux, Ubuntu Hardy/Gutsy/Dapper, Debian Etch/Sarge 
Fedora Core 6, Centos 475, NT Password Utils, mentestOb, 
and dban. Thanks to mfly for the menu-fu. 
elect the © to hoot or tal 


<F2> Hoot Uptions | <Fj-F4> DSL Uptions } <F5> Hel 
Darn Small Linux will boot in 38 suconds. . 
hoo 


—SHAWN POWERS 


One-Eyed, One-Horned, 
Flying Purple...Ubuntu? 


With the latest iteration of its Linux distribution, 
Canonical has changed its branding a bit. 
Although we might all speculate why it has 
moved on from its traditional brown themes, 
sadly the reality often is less exciting than spec- 
ulation. True, the rebranding is due to years of 
planning, research and marketing decisions, but 
| suspect a strong underlying set of reasons: 


lm UPS already had the corner of the brown 
market. 


m Ubuntu’s “Human” theme limited its 
interplanetary domination strategy. 


m Mark Shuttleworth heard enough “scat” jokes as they pertain to the color brown. 


@ The color brown would clash with the upcoming orange overtones of the 10.10 
version of Ubuntu, Marauding Marmaduke. 


All joking aside, the rebranding is a refreshing new look for Ubuntu. Whether it 
will have any effect on the marketability of Canonical’s flagship product remains to 
be seen. For those of us who were just about browned-out though, | think it’s safe 
to say, “Bring on the purple!” 

—SHAWN POWERS 
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Advanced MongoDB 


A look at some of MongoDB’s features, such as indexing and object 


relationships. 


Last month, | started discussing MongoDB, an 
open-source non-relational “document-based” 
database that has been growing in popularity 
during the past year. Unlike relational databases, 
which store all information in two-dimensional 
tables, MongoDB stores everything in something 
akin to a set of hash tables. 

In a relational database, you can be sure that 
every record (that is, row) in a table has the same 
number and set of columns. By contrast, MongoDB 
is schema-less, meaning there is no enforcement of 
such rules on columns. Two records in a MongoDB 
collection might have identical keys, or they might 
have no two keys in common. Ensuring that the keys 
are meaningful, and that they will not be prone to 
abuse or error, is the programmer's responsibility. 

Working with MongoDB turns out to be fairly 
straightforward, as | showed in several examples 
last month. Once you have set up a database and 
a collection, you can add, remove and modify 
records using a combination of objects in your 
favorite language and the MongoDB query language. 

The fact that it’s easy to work with MongoDB 
doesn’t mean that it’s lacking in high-powered 
features, however. This month, | describe some of 
the features you're likely to use if you incorporate 
MongoDB into your applications, such as indexing 
and object relationships. If you're like me, you'll see 
there is a lot to like; plus, using MongoDB prods you 
to think about your data in new and different ways. 


Indexing 

As | explained last month, MongoDB has its own 
query language, allowing you to retrieve records 
whose attributes match certain conditions. For 
example, if you have a book database, you might 
want to find all books with a certain title. One way 
to perform such a retrieval would be to iterate 
over each of the records, pulling out all those 
that precisely match the title in question. In Ruby, 
you could express this as: 


books.find_all {|b| b.title == search_title} 


The problem with this approach is that it’s quite 
slow. The system needs to iterate over each of the 
items, which means as the list of books grows, so too 
will the time it takes to find what you're seeking. 

The solution to this problem, as database 
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programmers have long known, is to use an index. 
Indexes come in various forms, but the basic idea 
is that they allow you to find all records with a 
particular value for the title immediately (or any 
column field), without having to scan through 
each of the individual records. It should come as 
no surprise, then, that MongoDB supports indexes. 
How can you use them? 

Continuing with this book example, | inserted 
about 43,000 books into a MongoDB collection. 
Each inserted document was a Ruby hash, storing 
the book's ISBN, title, weight and publication date. 
Then, | could retrieve a book using MongoDB’s 
client program, which provides an interactive 
JavaScript interface: 


./bin/mongo atf 
> db. books.count() 

38202 
> db. books. find({isbn: '9789810185060' }) 

{ "_id" : ObjectId("4b8fca3ef23f3c614600a8c2") , 
"title" : "Primary Mathematics 4A Textbook", 
"weight" : 40, 

"publication_date" : "2003-01-01", 
"isbn" : "9789810185060" } 

The query certainly seems to execute quickly 
enough, but if there were millions of records, it 
would slow down quite a bit. You can give the 
database server a speed boost by adding an index 
on the isbn column: 


> db.books.ensureIndex({isbn:1}) 


This creates an index on the isbn column in 
ascending order. You also could specify -1 (instead 
of 1) to indicate that the items should be indexed 
in descending order. 

Just as a relational database automatically puts 
an index on the “primary key” column of a table, 
MongoDB automatically indexes the unique _id 
attribute on a collection. Every other index needs to 
be created manually. And indeed, now if you get a 
list of the indexes, you will see that not only is the 
ison column indexed, but so is _id: 


> db. books. getIndexes() 
[ 


"name" > "id." 
"ns" : "atf.books", 
"key" + 


"id" : ObjectId("000000000000000000000000" ) 


"ns" : "atf.books", 
key" : { 

"isbn" : 1 
}, 
"name" : "isbn_1" 


Now you can perform the same query as 
before, requesting all of the books with a partic- 
ular ISBN. You won't see any change in your 
result set; however, you should get a response 
more quickly than before. 

You also can create a compound index, which 
looks at more than one key: 


> db.books.ensureIndex({title:1, weight:1}) 


Perhaps it doesn’t make sense to combine the 
index for a book's title with that of its weight. 
Nevertheless, that’s what | have now done in the 
example. If you later decide you don’t want this 
index, you can remove it with: 


> db.books.dropIndex('title_1l_weight_1') 
{ "nIndexesWas" : 3, "ok" : 1 } 


Because I’m using the JavaScript interface, the 
response is a JSON object, indicating that there used 
to be three indexes (and now there are only two), 
and that the function executed successfully. If you 
try to drop the index a second time, you'll get an 
error message: 


> db.books.dropIndex('title_1l_weight_1') 


{ "errmsg" "index not found", "ok" : @ } 


Indexes not only speed up many queries, but they 
also allow you to ensure uniqueness. That is, if you 
want to be sure that a particular attribute is unique 
across all the documents in a collection, you can 
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define the index with the “unique” parameter. 
For example, let's get a record from the 
current collection: 


> db.books.findOne() 
{ 
"“id" : ObjectId("4b8fc9baf23f3c6146000b90") , 
"title" : "\"Gateways to Academic Writing: Effective Sentences, 
Paragraphs, and Essays\"", 
"weight" : 0, 
"publication_date" : "2004-02-01", 
"isbn" : "0131408887" 


If you try to insert a new document with the 
same ISBN, MongoDB won't care: 


> db.books.save({isbn: '0131408887', title:'fake book'}) 


But in theory, there should be only one book 
with each ISBN. This means the database can (and 
should) have a uniqueness constraint on ISBN. You 
can achieve this by dropping and re-creating your 
index, indicating that the new version of the index 
also should enforce uniqueness: 


> db.books.dropIndex("isbn_1") 

{ "nIndexesWas" : 2, "ok" : 1 } 
> db.books.ensureIndex({isbn:1}, {unique:true}) 

E11000 duplicate key errorindex: atf.books.$isbn_1 

»dup key: { : "0131408887" } 

Uh-oh. It turns out that there are some dupli- 
cate ISBNs in the database already. The good 
news is that MongoDB shows which key is the 
offender. Thus, you could go through the 
database (either manually or automatically, 
depending on the size of the data set) and 
remove this key, re-try to create the index, and 
so on, until everything works. Or, you can tell 
the ensurelndex function that it should drop any 
duplicate records. 

Yes, you read that correctly. MongoDB will, if 
you ask it to, not only create a unique index, but 
also drop anything that would cause that constraint 
to be violated. I’m pretty sure | would not want to 
use this function on actual production data, just 
because it scares me to think that my database 
would be removing data. But in this example case, 
with a toy dataset, it works just fine: 


> db.books.ensureIndex({isbn:1}, {unique:true, dropDups:true}) 
£11000 duplicate key errorindex: atf.books.$isbn_1 
dup key: { : "0131408887" } 


Now, what happens if you try to insert a 
non-unique ISBN again? 
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> db.books.save({isbn: '0131408887', title: 'fake book'}) 
E11000 duplicate key errorindex: atf.books.$isbn_1 
dup key: { : "0131408887" } 


You may have as many indexes as you want on 
a collection. Like with a relational database, the 
main cost of an index is obvious when you insert 
or update data, so if you expect to insert or update 
your documents a great deal, you should carefully 
consider how many indexes you want to create. 

A second, and more subtle, issue (referenced 
in David Mytton’s blog post—see Resources) is that 
there is a namespace limit in each MongoDB 
database, and that this namespace is used by 
both collections and indexes. 


Combining Objects 

One of the touted advantages of an object 
database—or a “document” database, as MongoDB 
describes itself—is that you can store just about 
anything inside it, without the “impedance mismatch” 
that exists when storing objects in a relational 
database's two-dimensional tables. So if your 
object contains a few strings, a few dates and 

a few integers, you should be just fine. 

However, many situations exist in which this is 
not quite enough. One classic example (discussed 
in many MongoDB FAQs and interviews) is that of 
a blog. It makes sense to have a collection of blog 
posts, and for each post to have a date, a title and a 
body. But, you'll also need an author, and assuming 
that you want to store more than just the author's 
name, or another simple text string, you probably 
will want to have each author stored as an object. 

So, how can you do that? The simplest way is 
to store an object along with each blog post. If you 
have used a high-level language, such as Ruby or 
Python before, this won't come as a surprise; you're 
just sticking a hash inside a hash (or if you're a 
Python hacker, then a dict inside of a dict). So, 
in the JavaScript client, you can say: 


> db.blogposts.save({title: title’, 
body: 'this is the body' 
author: {name:'Reuven', 
email: 'reuven@lerner.co.il'} }) 


Remember, MongoDB creates a collection for 
you if it doesn’t exist already. Then, you can retrieve 
your post with: 


> db.blogposts. findOne() 


{ 
"Vid" : ObjectId("4b91070a9640ce564dbe5a35") , 


“tithe < “ithe”, 
"pody" : "this is the body", 
"author" : { 


"name" : "Reuven", would do with a relational database. 


"email" : "reuven@lerner.co.il" The advantages of a non-normalized approach 
} are that it's easy to work with in general and is 

} much faster. The disadvantage, as everyone who 

ever has studied normalization knows, is that if you 

Or, you can retrieve the e-mail address of that need to update the author's e-mail address, you 
author with: need to iterate over all the entries in your collection 

an expensive task in many cases. In addition, there's 
> db.blogposts.findOne()['author']['email'] always the chance that different blog postings will 
reuven@lerner.co.il spell the same author's name in different ways, 
leading to problems with data integrity. 
Or, you even can search: If there is one issue that gives me pause when 
working with MongoDB, it is this one—the fact that 
> db.blogposts.findOne({title:'titleee'}) the data isn’t normalized goes against everything 
null that I’ve done over the years. I’m not sure whether 
my reaction indicates that | need to relax about 

In other words, no postings matched the this issue, choose MongoDB only for particularly 
search criteria. appropriate tasks, or if I'm a dinosaur. 

Now, if you have worked with relational MongoDB does offer a partial solution. Instead 
databases for any length of time, you probably are of embedding an object within another object, you 
thinking, “Wait a second. Is he saying | should store can enter a reference to another object, either in 
an identical author object with each posting that the same collection or in another collection. For 
the author made?” And the answer is yes—some- example, you can create a new “authors” collection 
thing that | admit gives me the heebie-jeebies. in your database, and then create a new author: 
MongoDB, like many other document databases, 
does not require or even expect that you will > db.authors.save({name:'Reuven', email:'reuven@lerner .co.il'}) 


normalize your data—the opposite of what you 
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> a = db.authors.findOne() 
{ 
"Vid" : ObjectId("4b910a469640ce564dbe5a36") , 
"name" : "Reuven", 


"email" : "reuven@lerner.co.il" 


Now you can assign this author to your blog 
post, replacing the object literal from before: 


> p = db.blogposts.findOne() 


> p['author'] =a 


> p 
{ 
"id" : ObjectId("4b91070a9640ce564dbe5a35") , 
"title" : "title", 
"body" : "this is the body", 
"author" : { 
"Vid" : ObjectId("4b910a469640ce564dbe5a36") , 
"name" : "Reuven", 


"email" : "reuven@lerner.co.il" 


Although the blog post looks similar to what 
you had before, notice that it now has its own 


Resources 


The main site for MongoDB, including source code and documentation, is at 
mongodb.org. A reference guide to the interactive, JavaScript-based shell 
is at www.mongodb.org/display/DOCS/dbshell+Reference. 


For an excellent introduction to MongoDB, including some corporate 
background on 10gen and how it can be used in your applications, listen 
to episode 105 of the “FLOSS Weekly” podcast. | found the podcast to 
be both entertaining and informative. 


Another good introduction is from John Nunemaker, a well-known 
blogger in the Ruby world: railstips.org/blog/archives/2009/06/03/ 
what-if-a-key-value-store-mated-with-a-relational-database-system. 


Mathias Meyer wrote a terrific introduction and description of MongoDB on 
his blog: www.paperplanes.de/2010/2/25/notes_on_mongodb.html. 


Because MongoDB is a “document” database, you might be wondering 
if if there is any way to generate a full-text index on a document. The 
answer is “kind of", with more information and hints available at 
www.mongodb.org/display/DOCS/Full+Text+Search+in+Mongo. 


Finally, David Mytton recently wrote a blog post, in which he described 
some of the issues he encountered when using MongoDB in a produc- 


tion environment: blog.boxedice.com/2010/02/28/ 
notes-from-a-production-mongodb-deployment. 
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“ 


_id” attribute. This shows that you are referencing 
another object in MongoDB. Changes to that object 
are immediately reflected, as you can see here: 


> a['name'] = ‘Reuven Lerner' 
Reuven Lerner 
> /p 
{ 
"Vid" : ObjectId("4b91070a9640ce564dbe5a35") , 
"title" ; "title", 
"pody" : "this is the body", 
"author" : { 
"Vid" : ObjectId("4b910a469640ce564dbe5a36") , 
"name" : "Reuven Lerner", 


"email" : "reuven@lerner.co.il" 


See how the author's “name” attribute 
was updated immediately? That's because you 
have an object reference here, rather than an 
embedded object. 

Given the ease with which you can reference 
objects from other objects, why not do this all the 
time? To be honest, this is definitely my preference, 
perhaps reflecting my years of work with relational 
databases. MongoDB’s authors, by contrast, indicate 
that the main problem with this approach is that it 
requires additional reads from the database, which 
slows down the data-retrieval process. You will have 
to decide what trade-offs are appropriate for your 
needs, both now and in the future. 


Conclusion 

MongoDB is an impressive database, with extensive 
documentation and drivers. It is easy to begin 
working with MongoDB, and the interactive shell 

is Straightforward for anyone with even a bit of 
JavaScript and database experience. Indexes are 
fairly easy to understand, create and apply. 

Where things get tricky, and even sticky, is 
precisely in the area where relational databases 
have excelled (and have been optimized) for 
decades—namely, the interactions and associa- 
tions among related objects, ensuring data 
integrity without compromising speed too much. 
I'm sure MongoDB will continue to improve in 
this area, but for now, this is the main thing that 
bothers me about MongoDB. Nevertheless, I’ve 
been impressed by what I’ve seen so far, and | 
easily can imagine using it on some of my future 
projects, especially those that will have a limited 
number of cross-collection references.™ 


Reuven M. Lerner is a longtime Web developer, trainer, and consultant. He is a 
PhD candidate in Learning Sciences at Northwestern University. Reuven lives 
with his wife and three children in Modi‘in, Israel. 
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SF work tHe sue 


DAVE TAYLOR 


i} Simple Scripts 


to Sophisticated 


HTML Forms 


Building on the Yahoo Movies search form script. 


Last month, we looked at how to convert an 
HTML form on a page into a shell script with 
command flags and variables that let you have 
access to all the features of the search box. We 
tapped into Yahoo Movies and are building a script 
that offers up the key capabilities on the search 
form at movies.yahoo.com/mv/advsearch. 

The script we built ended up with this usage 
statement: 


USAGE: findmovie -g genre -k keywords -nrst title 


So, that gives you an idea of what we're trying to 
do. Last month, we stopped with a script that offered 
the capabilities above and could open a Web browser 
with the result of the search using the open command. 

Now, let’s start with a caveat: open is a Mac OS X 
command-line script that lets you launch a GUI app. 


What if the user wants the option 


of dumping the data to the command 
line instead of launching a browser? 


Just about every other Linux/UNIX flavor has a similar 
feature, including if you're running the X Window 
System. In fact, with most of them, it’s even easier. 
A typical Linux version of “open a Web browser 
with this URL loaded” might be as simple as: 


firefox http://www.linuxjournal.com/ & 


That's easily done, even in a shell script. 

Actually, if you're going to end a script by 
invoking a specific command, the best way to 
do it is to “exec” the command, which basically 
replaces the script with the app you've specified, 
so it’s not still running and doesn't even need 
to exit. So in that case, it might look like exec 
firefox "$url" as the last line of the script. 

This month, | want to go back and make our script 
do more interesting things. For now, an invocation like: 
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./findmovie.sh -g act evil 


produces a command from the last few lines in 
the script: 


echo $baseurl${params}\&p=$pattern 
exec open -a safari "$baseurl${params}\&p=$pattern" 


that ends up pushing out this: 


http://movies.yahoo.com/mv/ 
search?yr=al L&syn_match=al L&adv=y&t ype=feature&gen=ac t&p=evil 


It’s pretty sophisticated! 


Letting the User Dump the Resultant 
Data 

What if the user wants the option of dumping the 
data to the command line instead of launching a 
browser? We can address that by adding a -d dump 
command flag into the getopt block: 


while getopts "dg:k:nrst" arg 
do 
case "$arg" in 
d ) dump=1 ;; 
g ) params="${params:+$params&}gen=$0PTARG" ;; 


To dump the data, we'll enlist the powerful curl 
command, as we've done in the past. The program 
has zillions of options, but as we're just interested in 
the raw output, we can ignore them all (fortunately) 
except for --silent, which hides status updates, 
leaving the conditional: 


if [ $dump -eq 1] ; then 

exec /usr/bin/curl --silent 
"$baseurl${params}\&p=$pattern" 
else 

exec open -a safari "$baseurl${params}\&p=$pattern" 
ta 


But, that generates a huge amount of data, 
including all the HTML needed to produce the page 


in question. Let's spend just a minute looking closely at that 
output and see if there's a way to trim things at least a bit. 

It turns out that every movie title that’s matched includes 
a link to the movie's information on the Yahoo Movies site. 
Those look like: 


<a href="http://movies.yahoo.com/movie/1809697875/info">Resident Evil 


So, that's easy to detect. Better, we can use a regex expression 
with grep and skip a lot of superfluous data too: 


cmd | grep '/movie/.*info' 


That comes close to having only the lines that match 
individual movies, but to take this one step further, let's remove 
the false matches for dvdinfo, because we’re not interested 
in the links to DVD release info. That's a grep -v: 


cmd | grep '/movie/.*info' | grep -v dvdinfo 


Now, let’s have a quick peek at comedies that have the 
word “funny” in their titles: 


./findmovie.sh -d -g com funny | grep '/movie/.*info' 
‘| grep -v dvdinfo | head -3 


<td><a href="http://movies.yahoo.com/movie/1810041785/info"> 
<b>Funny</b> People (2009)</a><br> 


<td><a href="http://movies.yahoo.com/movie/1809406735/info">What's So 
<b>Funny</b> About Me? (1997)</a><br> 


<td><a href="http://movies.yahoo.com/movie/1808565885/info">That 
<b>Funny</b> Feeling (1965)</a><br> 


Okay, so the first three films in that jumble of HTML are Funny 
People, What's So Funny About Me? and That Funny Feeling. 

From this point, you definitely can poke around and write 
some better filters to extract the specific information you want. 
The wrinkle? Like most other sites, Yahoo Movies chops the results 
into multiple pages, so what you'd really want to do is identify 
how many pages of results there are going to be and then grab 
the results from each, one by one. It's tedious, but doable. 


How Many Matches? 

Let's look at a more interesting subset, instead, by adding a -c 
flag to have it output just a count of how many films match 
the specified criteria, you've given the command instead. 

To do that, we don’t need to go page by page, but just 
identify and extract the value from the match count on the 
page. For the comedies with “funny” in the title, the line on 
the page looks like this: “< Prev | 1 - 20 of 37 | Next 17 >”. 

What we need to do is crack the HTML and look at the source 
to the link to “next 17” and see if it’s extractable (is that a word?): 


./findmovie.sh -d -g com funny | grep -i "next 17" | head -1 


<td align=right><font face=arial size="-2"><nobr> 
=&Lt;&nbsp;Prev&nbsp; |&nbsp;<b>1 - 20</b> 

»&nbsp; of&nbsp; <b>37</b>&nbsp; | nbsp; <span 
class="yperLlink"><ai href="/mv/search?p=funny&yr=all 
=&gen=com\&syn_match=al l&adv=y&type=feature 

> &n=17&b=21&h=s">Next 17</a>&nbsp;&gt; 
&nbsp;</nobr></span></span></font></td></tr> 


Well that’s ugly. You'd think Yahoo didn’t want to make 
this easy or something! It turns out though that this is a pretty 
tricky task, because if there are no matches, the link doesn’t 
show up, and instead you see “Sorry, no matches were 
found”. If there are less than 20 matches, you see “Next >”, 
but it’s not a clickable link, so it's not going to be so easy! 

Given that I’m out of space, let’s defer this topic until 
next month. Meanwhile, look at the source to various searches 
yourself and see if anything comes to mind. Otherwise, it'll 
be brute force! m 


Dave Taylor has been hacking shell scripts for a really long time, 30 years. He's the author 
of the popular Wicked Cool Shell Scripts and can be found on Twitter as @DaveTaylor and 
more generally at www.DaveTaylorOnline.com. 
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PARANOID PENGUIN 


MICK BAUER 


Linux VPNs with 
OpenVPN, Part V 


Tips for success in using OpenVPN for secure remote access. 


In my four previous columns, | showed, in painstaking 
detail, how to set up OpenVPN to allow remote 
users to create secure remote-access connections— 
Virtual Private Network (VPN) tunnels—over the 
Internet back to your personal or corporate network. 
By now, you should understand how VPN technologies 
in general, and TLS/SSL-based VPNs in specific, 
work and how to create working server and client 
configurations for OpenVPN. 

This month, | wrap up the series, with some 
miscellaneous but important notes about the previous 
columns’ client-server scenario, including instructions 
on enabling IP forwarding, some tips on using a 


Listing 1. Server's server.ovpn File 


Web proxy and enforcing DNS use through the 
tunnel, and on “hiding” all VPN clients’ IP addresses 
behind that of your OpenVPN server. 


Review 
Throughout this series, I’ve been implementing the 
OpenVPN server configuration shown in Listing 1, 
which causes OpenVPN to run in server mode. In 
my example scenario, I’ve got only one remote user 
connecting to this OpenVPN server, but if you have 
more, you should edit the max-clients parameter 
accordingly. Remember, because I've also set fairly 
liberal tunnel timeouts in order to minimize the odds 
that a tunnel will go down due to network problems, 
you should add 1 or 2 to the actual number of 
maximum concurrent client connections you expect. 
The other setting in Listing 1 that | need to 


port 1194 review is push "redirect-gateway defl 
proto udp bypass-dhcp", which pushes the OpenVPN's local 
dev tun default gateway setting to all clients. This has the 


ca 2.0/keys/ca,crt 

cert 2.0/keys/server.crt 

key 2.0/keys/server.key # This file should be kept secret 
dh 2.0/keys/dh1024.pem 

tls-auth 2.0/keys/ta.key 0 


Sever UO sil. 330) 255.755.2755) 40) 
ifconfig-pool-persist ipp.txt 
push "redirect-gateway defl bypass-dhcp" 


keepalive 10 120 


cipher BF-CBC 


comp-1zo 


# Blowfish (default) 


effect of causing VPN clients to route all their 
Internet traffic through the VPN tunnel, which (as 
| discuss shortly) has important security benefits. 

The client configuration file that corresponds to 
Listing 1 is shown in Listing 2. This file works equally 
well on Linux and Windows client systems. Remember 
that the parameter remote specifies the IP address 
or hostname of your OpenVPN server and the port 
on which it’s accepting connections. 

Remember also that the files ca.crt, minion.crt, 
minion.key and ta.key specified by the parameters 
ca, cert, key and tls-auth, respectively, need to 
be generated beforehand and placed alongside 
the configuration file itself in /etc/openvpn. The 
certificate and key specified by ca and cert should 


max-clients 2 be unique for each client system! 

Again, the purpose of the server configuration in 
Listing 1 and the client configuration in Listing 2 is 
to allow a remote user to connect from over the 
Internet back to the “home” network on which the 
OpenVPN server resides. (This may or may not be 
your residence. By home network, | mean “trusted 
status openvpn-status.log corporate or personal network”, as opposed to 
verb 3 the remote network from which you're trying 
mute 20 to connect.) Last month, however, | forgot to mention 

a critical step that you must perform on your 
OpenVPN server if you want remote clients to be 


user nobody 
group nogroup 
persist-key 
persist-tun 
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Listing 2. Client's client.ovpn File 


client 
proto udp 
dev tun 


remote 1,2,3.4 1194 
nobind 


ca ca.crt 
cert minion.crt 
key minion.key 


Ns eet ony pe servers 
tls-auth ta.key 1 


cipher BF-CBC 
comp-1zo 


user nobody 
group nogroup 
persist-key 
persist-tun 


mute-replay-warnings 


verb 3 
mute 20 


able to communicate with anything besides the 
server itself: enabling IP forwarding. 


Enabling IP Forwarding 
By default, almost any Linux system is configured 
not to allow network packets entering one network 
interface to be forwarded to and sent out of a 
different network interface. This is a Linux security 
feature. It helps reduce the likelihood of your Linux 
system linking different networks together in 
undesirable or unintended ways. 

But, generally you do want an OpenVPN server to 
link different networks. The exceptions to this are if: 


1. All services and resources your remote users need 
are housed on the OpenVPN server itself. 


2. It's possible to run proxy applications on the 
OpenVPN server that can proxy connections 
to services not hosted on it. 


In the first case, once remote users have connected 
to the OpenVPN server successfully, they can connect 
to other services hosted on that server by targeting 
the server's real/local IP address rather than its Internet- 
facing address. For example, the client configuration 
in Listing 2 is targeting a server address of 1.2.3.4, 
which is Internet-routable. Suppose that this is actually 


a router or firewall address that is translated to your 
OpenVPN server's address 10.0.0.4. 

To ssh to the OpenVPN server after you've estab- 
lished a tunnel to it, you'd target 10.0.0.4, not 1.2.3.4. 
The same would apply to Samba, NFS, HTTP/S or any 
other service running on the OpenVPN server. 

In the second case, to reach other resources 
on the remote network, you would configure the 
applications running on your client system to use the 
OpenVPN server's real/internal address (10.0.0.4) as 
its proxy address. The best example of this is Squid. If 
all the resources you wanted to reach on your remote 
network involve Web services, you could run Squid 
on the OpenVPN server and configure your client's 
Web browser to use 10.0.0.4 as its proxy address 
(although this will work only when the tunnel is up). 

In either of the above scenarios, you don’t need 
IP forwarding enabled on the OpenVPN server, 
because all direct communication between VPN 
clients and your home network terminates on the 
OpenVPN server. If, however, your clients need to 
reach other things on the home network or beyond, 
without using the OpenVPN server as a proxy, you 
do need to enable IP forwarding. 

This is very simple. To turn on IP forwarding with- 
out having to reboot, simply execute this command: 


bash-$ sudo sysctl -w net.ipv4.ip_forward=1 


To make this change persistent across reboots, 
uncomment the following line in /etc/sysctl.conf 
(you'll need to su to root or use sudo to edit this file): 


net.ipv4.ip_forward=1 


Web Proxies and VPN Clients 
In talking about the value of using VPN software 
when using untrusted networks like WLAN hot 
spots, I've described the benefits of using your 
home network's Web proxy rather than surfing the 
Web directly through the untrusted network. From 
a policy-enforcement standpoint, this allows you 
to enforce whatever URL or content filtering with 
which your home network's proxy is configured; 
from an endpoint-security standpoint, it makes 
phishing and man-in-the-middle attacks harder. 

On the downside, it also results in a somewhat 
slower Web browsing experience, because each 
user's Web traffic must traverse a longer, slower 
path than without the VPN tunnel in place. Also, 
making remote users use your corporate Web proxy 
without also configuring them to use your corporate 
DNS servers may fail to prevent man-in-the-middle 
attacks (in which DNS redirection is a common 
technique), giving a false sense of security. 

| return to the DNS problem shortly, but how 
do you use Web proxies with OpenVPN? It’s quite 


www.linuxjournal.com june 2010 | 27 


| PARANOID PENGUIN 


simple. On the Web proxy itself, you simply need to 
make sure there's an Access Control List (ACL) allowing 
client connections from tunnel IPs. This is a moot 
question if your Squid server is running on a different 
box from the OpenVPN server, and the OpenVPN 
server is using Network Address Translation (NAT) to 
“hide” all tunnel-originated packets behind its own 
IP address (I discuss NAT shortly). 

If, however, you are running the Web proxy 
on the OpenVPN server itself, you need an ACL. 
For Squid, you need to add something like this 
to /etc/squid/squid.conf: 


acl openvpn_tunnels src 10.31.33.0/24 
http_access allow openvpn_tunnels 


The acl line defines an object named 
openvpn_tunnels, representing transactions whose 
source IP addresses fall between 10.31.33.1 and 
10.31.33.254. The http_access line allows 
transactions initiating from this IP range. As 
with any other change you make to this file, 
you need to restart Squid for this ACL to take 
effect (sudo /etc/init.d/squid restart). 

Your clients will, of course, need to be configured 
to use your Web proxy, but they target the same IP 
address regardless of whether they're connecting 
from afar via OpenVPN or connecting directly to 
your LAN. That is, if you're already having your 
users proxy all their Web traffic, no change to their 
Web browser settings should be necessary for them 
to use the same proxy through OpenVPN. 


Enforcing DNS 

If you're requiring all remote users to route all their 
Internet traffic through the VPN tunnel, it isn’t 
enough to force them to use the remote network's 
default gateway. You also need to force them to use 
the remote network’s DNS servers. Otherwise, a 
man-in-the-middle attack that involves DNS spoofing 
on the client side of the tunnel will succeed. Once a 
remote user's browser has been handed a phishing 
site’s IP address for a given URL, it doesn't matter 
whether it connects to that IP directly or through 
the VPN tunnel (unless, perhaps, the phishing 
site's IP address is on a blacklist enforced by your 
corporate Web proxy or firewall). 

If your remote clients all run Windows, it’s easy 
to enforce server-side DNS settings. Simply add the 
following line to your OpenVPN server's OpenVPN 
configuration file: 


push "dhcp-option DNS 10.0.0.100" 
push "dhcp-option DNS 10.0.0.120" 


Of course, you should replace 10.0.0.100 and 
10.0.0.120 with the addresses of the DNS servers 
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you want your clients to use. 

Unfortunately, this won't work for non-Windows 
clients. For Linux and other UNIX clients, you'll need 
to edit those client systems’ /etc/resolv.conf files either 
manually or dynamically. The server-side configuration 
parameter foreign_option_<I>n<I> lets you pass 
data to tunnel-initiation scripts (--up scripts); for 
example, the line foreign_option_1=’dhcp-option 
DNS 10.0.0.100’ sends the line dhcp-option DNS 
10.0.0.100 to any defined “up” scripts, which can 
then act on that data. 

The details of how all this works are out of 
the scope of this article. Suffice it to say that the 
OpenVPN man page describes how “up” scripts 
work, and the link to the update-resolv-conf script 
in the Resources for this article provides a script you 
can alter to rewrite /etc/resolv.conf to give precedence 
to your “home” network's DNS servers. 


NAT and iptables on the OpenVPN Server 
There’s one more critical step necessary to allow 
remote users to route packets to the Internet 
through their VPN tunnels. You need to set up 
Network Address Translation (NAT) so that traffic 
entering your “home” network from VPN tunnels 
appears to originate from the OpenVPN server. 

This is because the networks from which remote 
clients connect will have either different network IP 
addresses than your “home” network, in which case 
the odds are your “home” network infrastructure 
won't have a route to the remote clients, or they'll 
have the same network IP addresses, in which case it's 
quite possible that different hosts on opposite ends of 
the VPN tunnels will have the same host IP addresses! 

Note that this problem plays out differently on 
“bridging” (Layer 2) VPN tunnels than on “routing” 
(Layer 3) VPN tunnels. Because all my examples so far 
have involved a routing VPN scenario, what I’m about 
to say regarding NAT applies to routed VPN tunnels. 

So, the way to sidestep the problem of foreign IP 
addresses on remote clients’ packets completely is 
simply to rewrite all packets entering the OpenVPN 
server's local network with the OpenVPN server's local 
IP address. To do so, add just one firewall rule, like this: 


bash-$ sudo iptables -t nat -A POSTROUTING 
=-s 10.31.33.0/24 -o eth® -j MASQUERADE 


Note that as with any other time you execute the 
command iptables, this is not a persistent change. 
To make this rule persistent across reboots, you need 
to add an equivalent line to whatever configuration file 
or script controls firewalling on your OpenVPN server. 

The OpenVPN man page has an entire section 
on firewalls (called “FIREWALLS”) that contains lots 
of good information about managing iptables fire- 
wall rules on your OpenVPN server. Remember, any 


VPN server is a security device. It's a good idea to run not 
just a single NAT rule, but a detailed set of filtering rules 
that restrict how people can connect to the server and to 
what systems your VPN clients may connect. 

(Speaking of iptables, it’s been a long time since | covered 
Linux’s powerful firewall capabilities in this column. Look for 
an in-depth article on writing your own Linux firewall rules in 
a future column.) 


Conclusion 

This article and my previous four columns covered Virtual 
Private Network principles and architectures; described a few 
VPN technologies available for Linux and how SSL/TLS solutions 
differ from IPsec; covered OpenVPN server configuration, 
including how to generate and manage digital certificates; 
and described client configuration and usage; all for a simple 
remote-access usage scenario. 

With all of that plus the practical use details | covered this 
month, you should be well on your way to a secure remote- 
access VPN solution using OpenVPN. If you decide to use 
OpenVPN instead or additionally to build network-to-network 
VPNs or to do a “bridging” OpenVPN solution, the OpenVPN 
man page, HOWTO and FAQ should make more sense to you 
now than they would have before reading these articles—all of 


which means, you no longer have any excuse to surf the Web 
through insecure wireless hot spots without protection !m 


Mick Bauer (darth.elmo@wiremonkeys.org) is Network Security Architect for one of the US's 
largest banks. He is the author of the O'Reilly book Linux Server Security, 2nd edition (formerly 
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Resources 


Official OpenVPN Home Page: www.openvpn.net 
OpenVPN FAQ: openvpn.net/index.php/open-source/faq.html 


OpenVPN HOWTO: www.openvpn.net/index.php/ 
open-source/documentation/howto.html 


Ubuntu Community OpenVPN Page: 
https://help.ubuntu.com/community/OpenVPN 


The update-resolv-conf Script by Thomas Hood and Chris 
Hanson: www.subvs.co.uk/openvpn_resolvconf 
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KYLE RANKIN 


Dynamic Config Files 


with Nmap 


Port scans aren't just for script kiddies and network troubleshooting. 
You also can use them to scan your network for clients and build your 


server configs dynamically. 


The great thing about tools is that you often can 
misuse them for a completely different purpose. The 
end of a screwdriver makes a passable hammer; a 
butter knife can be a screwdriver, and even a paper 
clip can substitute for a key in a pinch. Normally, 
you probably think of nmap as a security tool. After 
all, it's ideal when you want to test a machine for 
open, vulnerable ports. The other day though, | 
realized nmap had another use—a way to scan 
my network and build a dynamic configuration 
file based on what machines replied to my scan. 


Munin Is Trendy 

This whole project started when | decided to deploy 
Munin across my servers so | could graph trending 
data for each machine on my network. Munin is a 
great tool for trending, because once you install the 


Although this script worked great for 
Munin configs, you also could use the 
same procedure to scan for any number 
of services and build a configuration. 


agent, it often will discover what services and statistics 
to monitor and graph automatically. The downside 
for me though was that | already had a network full 
of servers. It was bad enough that | had to install 
an agent on each machine, but | also had to build a 
giant configuration file on my Munin server by hand 
that listed each server it should monitor. Plus, any 
time | added a machine to the network, | had yet 
another step in my build process as | had to add 
that new server to my Munin config. 

I'm a big fan of automation, and | figured there 
must be some easier way to add all my machines to 
this file. When you look at a Munin configuration 
file, it seems ripe for automation: 


dbdir /var/1lib/munin 
htmldir /var/www/munin 
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logdir /var/log/munin 
rundir /var/run/munin 
tmpldir /etc/munin/templates 


[web1.example.net] 
address webl.example.net 


[web2.example.net] 
address web2.example.net 


[db1.example.net] 
address dbl.example.net 


[db2.example.net] 
address db2.example.net 


The syntax for a generic munin.conf file is pretty 
straightforward. First, a few directories are defined, 
and then each server is defined within a pair of 
brackets. Inside those brackets, you can assign 
a name to the server or just use the hostname. 
After that, the following line lists the hostname 
or IP address for that server. In the above example, 
I've defined four servers. 

If | wanted to generate this configuration file 
automatically, | had to figure out some way to 
detect what servers were running Munin on my 
network. Munin makes this simple though, because 
each server has a Munin agent listening on port 
4949 by default. All | had to do was use nmap to 
scan the network and list all the machines that had 
port 4949 open. | figured | could parse that output 
and append it to my munin.conf file, and then 
maybe make a vim macro to go through each 
line and format it. 


Nmap with Grepable Output 

The first step was to find the right nmap syntax so 
that it would scan my network and list all machines 
that were listening to port 4949. First, | tried the 
standard command: 


$ nmap -p 4949 10.1.1.0/24 


Starting Nmap 4.11 ( http://www. insecure.org/nmap/ ) As you can see, for each machine that nmap 


at 2010-03-01 20:18 PST finds, it lists the IP, whether the port is open, 
and even tries to identify the type of machine. 
nteresting ports on 10.1.1.1: Even though you could grep out the machines 
PORT STATE SERVICE with open ports from this output, it would be 
4949/tcp closed unknown quite a pain to parse everything with the multi- 
MAC Address: @0:00:0C:01:CD:05 (Cisco Systems) line output. Instead, | used the -oG argument 
to nmap, which tells it to output in “grepable 
nteresting ports on purplel.example.net (10.1.1.50): format”, along with the - argument, which tells 
PORT STATE SERVICE it to send that output to STDOUT. The result was 
4949/tcp closed unknown much simpler to parse: 
AC Address: 08:00:20:CF:9D:D7 (SUN Microsystems) 
$ nmap -oG - -p 4949 10.1.1.0/24 
Interesting ports on webl.example.net (10.1.1.53): # Nmap 4.11 scan initiated Mon Mar 1 20:26:45 2010 as: 
PORT STATE SERVICE nmap -oG - -p 4949 
4949/tcp open unknown # 10.1.1.0/24 
MAC Address: 00:50:56:92:34:02 (VMWare) Host: 10.1.1.1 () Ports: 4949/closed/tcp///// 
Host: 10.1.1.50 (purplel.example.net) Ports: 4949/closed/tcp///// 
Interesting ports on web2.example.net (10.1.1.67): Host: 10.1.1.53 (webl.example.net) Ports: 4949/open/tcp///// 
PORT STATE SERVICE Host: 10.1.1.67 (web2.example.net) Ports: 4949/open/tcp///// 


4949/tcp open unknown 
MAC Address: 00:30:48:A0:12:98 (Supermicro Computer) 
Now | could just grep for “open”, and I'd get a 
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Listing 1. Script to Build Configuration File 
#!/usr/bin/perl 


my $munin_dir = '/etc/munin'; 

my $munin_config = 'munin.conf'; 

my $munin_config_temp = 'munin.conf.tmp'; 

my $node_port = '4949'; 

my $nmap = "nmap -oG - -p "; 

my %subnets = ( 
"10.1.1.0/24" => "VLAN" 
"10.1.5.0/24" => "VLAN5" 
"10.1.6.0/24" => "VLAN6" 


# iterate through each subnet and perform the nmap scan 
foreach $subnet (keys %subnets) { 
open NMAP, "$nmap $node_port $subnet | grep open |" 
sor die "Can't run nmap: $!\n" 
while (<NMAP>) { 
$ip = $host = ""; 
# parse out the hostname and IP address 
/Host: (\d+\.\d+\.\d+\.\d+) \((.*2)\)/; 
$ip = $1; $host = $2; 


next if($ip eq ""); 


# sometimes nmap doesn't do rDNS properly, 
# get it manually in that case 
if($host eq ""){ 
$host = “dig -x $ip +short* or $host = $ip; 
chomp $host; 
$host =~ s/\.$//; 


list of all machines running Munin: 


$ nmap -oG - -p 4949 10.1.1.0/24 | grep open 


$munin_hosts{$host} = $ip; 
} 
close NMAP; 


# output to a temp file in case munin 

# runs while this script is open 

open OUTFILE, "> $munin_dir/$munin_config_temp" or die "Can't open 
$munin_dir/$munin_config_temp: $!\n"; 


# first print out the standard header for the munin file 
print OUTFILE <<END_HEAD; 

dbdir = /var/1lib/munin 

htmldir /var/www/munin 

logdir /var/log/munin 

rundir = /var/run/munin 

tmpldir /etc/munin/templates 


END_HEAD 


# then print out the config for each host 

foreach $host (sort keys %munin_hosts) { 
print OUTFILE "\[$host\]\n\taddress $host\n" 
# add any extra munin options for each host here 
print OUTFILE "\n"; 

} 

close OUTFILE; 


system("mv $munin_dir/$munin_config_temp $munin_dir/$munin_config") ; 
and was comfortable with it, | went ahead and 


copied the script into /etc/cron.daily. Of course, 
on my real network, I've added a few other 


Host: 10.1.1.53 (web1.example.net) Ports: 4949/open/tcp///// fancy touches. For instance, every server on my 
Host: 10.1.1.67 (web2.example.net) Ports: 4949/open/tcp///// network has a DNS TXT record that says what 


Perl to the Rescue 


the server does. It is a useful practice for many 
reasons, but in this case, | found that because 


Once | started working on the regular expressions 
to parse through this output and generate the 
syntax | needed, | realized | should ditch vim 
and just write a script that built the entire con- 
figuration file for me and run that script with 
cron. That way, I’d never have to add a new 
server again. The only challenge was that | had 
multiple subnets | wanted to scan, and | discovered 
that sometimes nmap didn’t resolve the IP addresses 
into hostnames for me. Listing 1 shows the 
resulting script. 

Other than the hashes and a little fun with 
regular expressions, the bulk of this script is 
basic Perl. Once | tested it a few times by hand 
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| used the same TXT record for similar servers, | could 
look it up and use that to group servers together 
under that heading. 

Although this script worked great for Munin 
configs, you also could use the same procedure 
to scan for any number of services and build a 
configuration. | could see scripts that generate 
configuration files for Nagios, programs that 
poll SNMP or any other program that monitors 
multiple servers over a known port.m 


Kyle Rankin is a Systems Architect in the San Francisco Bay Area and the author of 
a number of books, including The Official Ubuntu Server Book, Knoppix Hacks and 
Ubuntu Hacks. He is currently the president of the North Bay Linux Users’ Group. 
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Organizing a Library 


“What is a library? It’s like Google made out of a tree.” 


—tevoul on Reddit.com 


At first glance, you might assume that I’m going 
to discuss code libraries in this article, but instead, 
I'm talking about an actual library—one made of 
books, magazines and other dead-tree sources 
of wisdom. | have always collected books, and 
each new project or pastime becomes an excuse 
to expand my library. | don’t always know what 

| have or, more important, where a certain book 
is. | try to keep my library organized in a physical 
sense, but I’ve always wanted a system that kept 
better track of my books. 


Goals and Deliciousness 

The goals for this project are pretty straightforward. 
| need something that can track all of the books | 
own. A big part of my collection is in my library at 
home, but | also have a large set of technical books 
at my office. I’d love to be able to see images of the 
covers (a la Delicious Monster—a Mac program that 
originally inspired me to sort this out). | also need 
something to show me where in the library the 
book is physically—the cabinet and shelf would 
be nice. One last thing is data entry. | have several 
thousand books, and I'd prefer not to have to 
type in a lot of information. 


First Stop: Actual Library Software 
The cool part about the Open Source world is that 
you can access software that is way beyond the 
scale of what you need. In the case of this project, 
| found Koha. According to the Web site, “Koha is 
the first open-source Integrated Library System (ILS). 
In use worldwide, its development is steered by 
a growing community of libraries collaborating 
to achieve their technology goals.” The project 
is targeted at actual libraries, which sounded like 
overkill, but | could not resist downloading and 
taking it for a spin. 

| decided to play with the development version 
(as the last release was June 2009). The first step 
was to check out the code repository: 


git clone git://git.koha.org/pub/scm/koha.git kohaclone 


The repository actually had install instructions 
for several distributions. Because I’m running 
Ubuntu, | followed those instructions. Based on 
the differences between the Web site instructions 
for installing on Hardy (8.04) and the instructions in 


34 | june 2010 www.linuxjournal.com 


the development version, it looks like a number of 
packages outside the standard package tree have 
been added. That is a good sign, because it means 
installation will get easier and easier. Be warned 
though, Koha is built using Perl, and a few Per! 
libraries are not currently packaged in Jaunty. The 
instructions show you how to use CPAN to install 
them properly (although that means you will have 
CPAN versions that are not controlled by the package 
system—a side effect of working with CPAN). 
After following all the instructions and getting 
everything installed, | ran through the Web 
install to set up the database. 

Once everything was up and “running”, | was 
ready to dive in to the heady world of running my 
own library. After spending an inordinate amount 
of time figuring out that | needed to provide some 
default values for the library and the type of 
content | was going to track, | was ready to add 
my first book. Pulling up Koha’s add form presents 
a huge page of options, most of which meant very 
little to me (such as Leader, Control Number Identified 
and Fixed Length Data Elements). | forged ahead by 
trying to search for one of my test books by ISBN. | 
had to do something called a Z39.50 search. This is 
a protocol used for getting book information from 
other libraries. In the process, | learned that | had to 
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Figure 1. The Koha catalog screen—something tells me this 
is overkill. 


add my own Z39.50 sources. | used the Library of 
Congress, because | figured it would have the most 
complete records (Settings are 2390.loc.gov:7090 
Database:Voyager - Syntax USMARC). Once all that 
was set up, | was able to add the book. 

All of the above was a lot of work, and | added 
only a single book. As much as | would like to use 
an industrial-strength tool, the system was too 
confusing for me as a layperson (my wife was kind 
enough to point out that there is a reason it is 
called Library Science). If you want to see what a 
properly configured Koha system is capable of, go 
to the Plano ISD library system (see Resources), 
which is running a version of Koha. It shows the 
book covers and even has a shelf browser. So if 
you have your own public library, Koha is really 
neat, but | realized | needed something else. 


“Personal” Is the Keyword 

| eventually figured out that the problem with my 
previous searches for software was the omission of 
the word “personal”. Adding that word narrows 
down the Google search a lot. As a result, | found 
two different options to consider: Alexandria and 
GCstar. Unlike Koha, both are available as Ubuntu 
packages. After dealing with the install guide for 
Koha, it was nice that all | had to do was apt-get 
install, and | could try them both (well, that was 
almost all | had to do). In the process of playing 
with these tools, | found another application 
called Tellico. It was nice to have several apps 
from which to choose. 


Alexandria 

Alexandria is a Ruby GNOME application for managing 
a book collection. The current official version is 
0.6.5. Things got off to a very bumpy start with 
Alexandria. The default version in Jaunty is 0.6.3. 
It was not able to find either of the test books. 
Even worse than that, it crashed and exited 
when | tried to search by ISBN. Not one to give 
up easily, | ended up downloading a current beta 
version (0.6.6-beta1). There was a problem related 
to two Ruby libraries because | was installing it 
under Jaunty. To get everything to work, | had to 
install two gems (hpricot and htmlentities) and 
manually install the package: 


sudo dpkg --ignore-depends=Libhpricot-ruby -i 
=Desktop/alexandria_0.6.6betal.deb 


The system relies on Amazon for some of the 
lookups. Due to a change in Amazon's policy, | 
had to sign up to get my own Amazon AWS access 
key. An explanation and link are available on the 
Alexandria Web site (see Resources). Technically, 
| could have removed Amazon as a provider and 
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skipped this step. 

The application itself is very simple, which 
was a nice change after wading through so 
many screens on Koha. You can search for books 
by title or ISBN. It lets you browse your library 
and search by details. 


GCstar 

GCstar collection management started out as 
GCfilms. As a result, it supports many different 
kinds of collections, including books, movies, music 
and board games, among others. It also allows you 
to define your own collection type, so you can track 
and collect anything you want. 


By Oriete 


Figure 3. GCstar Loaded with Books 


Installing GCstar was easy. | installed the package 
and then started the application. Obviously, | chose 
to start a collection of books. | clicked Add and 
started the process of looking up a book. | tried to 
use Amazon as an information source, but it never 
found anything. | assume this is related to the same 
policy change that affected Alexandria. | ended up 
using ISBNdb.com as my main source and was able 
to pull up information and book covers for all my 
test books. To make sure this wasn’t fixed in a later 


Figure 2. 
Alexandria Loaded 
with Some Books 
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Figure 4. Default 
Tellico View 
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version, | upgraded the package to 1.5.0, and it still 
had the same problem. 


Tellico 

Tellico is a collection management application 
for KDE. It was available as a package, which 
installed with no problems. After creating a new 
collection of books, my first step was to add 

one of the test books. The process of adding 

a book was the most confusing out of the three 
applications. | clicked Create a new entry, which 
pulled up a dialog with a lot of options spread 
out over six different tabs. Title was on the first 
tab. ISBN was on the Publishing tab. | entered in 
a title for a book and clicked Save Entry. On the 
other applications, doing that triggered a lookup, 
but Tellico just sat there with no additional data. 
Eventually, | found an option to say Update Entry, 
which was able to pull down information and 
update it (though no book cover was provided). 

| tried a second time, and this time, | filled out 
only the ISBN field. | saved the entry and asked 
it to update, but nothing changed. 

The version that shipped with Jaunty was 1.3.5. 
Version 2.1 was available as a Lucid package, so | 
decided to install that to see if any of these problems 
had been resolved. The good news is that the 
newer version fixed the problem with Amazon. The 
bad news is that it still was not able to look up the 
book with only the ISBN. The ISBN allows you to 
identify a book uniquely, which should simplify the 
process of confirming what book you are talking 
about. Searching by title provides a list of a lot of 
other books that are not the ones | want. 


Adding Additional Lookup Sources 
Now that | was able to add books to all three appli- 
cations, | wanted to see how hard it was to add 
additional sources for lookup. GCstar ships with a 
number of sources. The application itself does not 
let you add or configure any of the sources, so your 
only option is to pick which one to use. The process 
of adding a book was straightforward. You just click 
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Add and then put in the information. | am not sure 
if the problem was with authentication or something 
else, but the tool never found anything using 
Amazon as a source. | was able to pull up information 
about my books using ISBNdb.com. Once GCStar 
finds a book, the system pulls in a lot of details, 
including the book cover. There also is a field for 
storing the book’s location. It is just a free-text field, 
so | would have to come up with my own way of 
encoding location. You can search by location, but 
there is no way to sort by it or store the search, so 
you can’t browse the shelves based on where they 
are, which ends up being useful in my library, as | 
keep books on the same topic clumped together. 

GCstar does not have any support for a scanner; 
however, it does have a number of different options 
for importing data. It even can import an Alexandria 
collection. One way to get the data into the system 
is to put the ISBN numbers into a CSV file, and 
GCstar then can import that CSV. Once the data 
is loaded, you have to go to each book to trigger 
the lookup in the remote repository. 

Alexandria allowed me to add my Amazon 
credentials. It also supports adding in custom Z39.50 
sources. Tellico had the most extensive list of 
options for adding additional sources. It included 
support for Z39.50 as well as GCstar plugins. 


Where Is That Book? 

One of the problems | run into with my library is 
that even if | remember | have a book, | don't 
remember where it is. Recently, | moved a large 
chunk of my technical books to my office, making 
the situation even worse, so | want to be able to 
track books’ locations. 

Alexandria does not have any concept of location 
baked in. It does support tags, which would allow 
me to enter a tag to give me a better idea about 
a book's location (for example, Home:Cabinet 
1:Shelf 3). The search allows me to search by tags, 
so | could see other things on the same shelf, which 
would be useful because | tend to put books on the 
same subject next to each other. 

GCstar 1.3.2 had a field for location. The newer 
1.5 version has replaced that with support for tags. 
Once the books were tagged, | could browse the 
books by grouping them by tags. The search function 
did not support tags, so | couldn't limit my searches 
to books only at home or only at my office. 

Tellico had the most advanced features for this 
part. | actually could add specific fields for library, 
cabinet and shelf. Then, | could use those fields for 
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grouping and searching. 


Entering Books into the System 
S All this searching and sorting is useful, but | saved the 
most important consideration for last. How do | get 
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COLUMNS 


all my books into the system? The first option is simply 
to type in the ISBN of all my books. If your library is 
small enough that you are willing to do this, you 
probably don’t need a system to track your books. 

The next option is a barcode scanner. | happen to 
have a Flic Bluetooth barcode scanner from a previous 
project, and | was fortunate enough to find a great 
guide to getting it working under Linux (see Resources). 
Once everything was set up, | was able to scan the 
ISBNs from all the books quickly into a text file. 

| tried to import the ISBNs into Tellico, but 
each time, it crashed on the import. | wasn’t able 
to confirm whether this was a problem with the 
program or the way | installed it. 

GCstar was able to import the list of ISBNs with 
no problem. The annoying part of that process was 
that once the books were imported, it did not do 
any lookup on the ISBN. | had to go to each book 
individually to tell it to download the data. Once | 
did, | got the book cover and everything else. 

Alexandria got it right. Not only did it do the 
import, but it also downloaded the information 
about the books. 

| realize that not everyone has a barcode scanner 
lying around. Don't worry; you have other options. If 
you have a Webcam, you can install ZBar. This barcode- 
scanning software turns your Webcam into a barcode 


Resources 


Koha: koha.org 
Plano ISD Library System: pisd.kohalibrary.com 
Alexandria: alexandria.rubyforge.org 


Changes to Amazon API Requires AWS Account: 
alexandria.rubyforge.org/news/2009-08-15--amazon-support.html 


GCstar: www.gcstar.org 
Tellico: tellico-project.org/about-tellico 


Linux wedge (driver) for Microvision Flic barcode scanner: www.gsmblog.net/ 
linux-wedge-driver-for-microvision-flic-barcode-scanner 


ZBar: sourceforge.net/projects/zbar 

Shelfari: www.shelfari.com 

LibraryThing: www.librarything.com 

“Amazon Acquires Shelfari: Moves to Corner Book-Centric 


Social Media”: techcrunch.com/2008/08/25/ 
amazon-aquires-shelfari-moves-to-corner-social-book-space 
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scanner. | was able to get the same list of barcodes 
from ZBar that | got from my barcode scanner. The 
only downside is that | had to bring each book to 
the camera. It's a lot cheaper, but not nearly as 
convenient if you are scanning in a lot of books. 


Remote Options 

All the solutions | looked at are downloadable, but 
it seems a little silly to ignore some of the options 
available on the Web. | looked at two different 
on-line options: Shelfari and LibraryThing. It was very 
easy to add a book on both sites. | also was able to 
import my list of ISBNs into both sites. On Shelfari, 
the import happened very quickly. On LibraryThing, 
it was thrown into a queue, and | was told that it 
would take up to an hour for the ISBNs to process. 

As for sources, LibraryThing supports more than 
690 different sources for information. Shelfari did 
not offer any information source options. Amazon 
acquired Shelfari in August 2008, so | assume that 
is where it gets all its data. 

Both sites support tags, so | can use that to 
encode the books’ locations. 

Because these are both Web sites, they offer 
advantages and disadvantages. You easily can 
access the library data from multiple computers. 
On the other hand, you may not want everyone 
in the world to know you have every book on 
Pokémon ever published. Originally, | was concerned 
any data | put into either site would be locked 
there, but after some surfing, | found that both 
sites will provide you with a complete download 
of your library data. 


Conclusion 

| had a Shelfari account before | wrote this article. 

| often use it to create virtual bookshelves to talk 
about what I’m reading or to recommend a reading 
list. | thought about moving my collection into it, 
but | would prefer to work locally before | deal with 
putting everything on the Internet. After looking 

at the various options, | decided to start with 
Alexandria. It was the easiest to use and was best 
for what | need it to do. Plus, it is built using Ruby 
(a language | know), so | might have a shot at 
adding any features | need. As a test, | exported 
the information | already had put into Shelfari 
into Alexandria. Then, | was able to export the 
Alexandria data to both Tellico and GCstar. That 
means once | collect all the data, | always can 
switch applications later, which may be essential, 
as | noticed Alexandria started to slow down with 
only 400 books in it. Now, | just need to carve 
out the time to get scanning!m 


Dirk Elmendorf is cofounder of Rackspace, some-time home-brewer, longtime 
Linux advocate and even longer-time programmer. 
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Mandriva Enterprise Server 


Mandriva bills its new Enterprise Server 5 (MES 5) as “simple and innovative”, combining the best of Linux (reliability, 
security, low admin costs) with the best of Mandriva Linux (easy to use, exclusive Mandriva tools and professional 
services) for the administration and integration of servers. The most noteworthy new feature in the update is increased 
scalability in virtualization, driven by the added kernel-based Virtual Machine (KVM) technology. Other new features 
include the integrated Mandriva Directory Server, reduced bootup times, increased modularization to allow easier 
configuration of specialized servers and reduced energy consumption, among others. 


Wwww.mandriva.com 
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Terracotta’s Ehcache 


Terracotta’s Ehcache, a popular open-source, enterprise-level caching solution, has added a new feature set wrapped 
in its latest 2.0 release. Terracotta says that Ehcache 2.0 adds enterprise-class capabilities of high-priced and proprietary 
technologies like Oracle Coherence without requiring application changes. Furthermore, this release brings instant 
scale to the majority of Java applications without code changes or costly database upgrades. Additional new features 
simplify the development effort, testing and scale-out, such as an express mode that easily clusters application data 
via configuration changes. Finally, a series of enterprise features better integrate Ehcache with the database, such as 
JTA for transactions and data write-behind to increase performance while avoiding database bottlenecks. 


www.terracotta.org 
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6WIND‘s 6WINDGate 


Embedded developer 6WIND’s newly upgraded 6WINDGate, a packet processing application for networking \ 
and telecommunications systems, adds new features, such as ten-fold acceleration of packet processing functions 

and support for the multicore, embedded Intel Xeon processors EC5549 and E5645. The 10x speed-up compared @ 

to a standard Linux implementation allows customers to reuse their existing application software and accelerate 
their time to market. 6WIND further adds that the 6WINDGate SDS profile is optimized for platforms in 
which the networking Fast Path runs on dedicated cores without the overhead of a Linux-based Slow Path. 
6WINDGate's architecture removes the complexity of integrating high-performance packet processing with 
the Linux environment, because it fully synchronizes the Fast Path and Linux, while preserving Linux APIs. It 
includes complete Layer 2 through Layer 4 embedded networking features (routing, IPsec, firewall, QoS, NAT, 
multicast and so on), reducing development time by as much as 70%. 


WIND 


www.6wind.com 


Scott F. Andrews’ The Guild Leader's 
Handbook (No Starch Press) 


“Who said dragon slaying was easy?” is author Scott F. Andrews’ Bilbo Baggins-esque 
invitation to try his new book The Guild Leader’s Handbook, a guide to leading a guild 

in massively multiplayer on-line (MMO) games. Subtitled “Strategies and Guidance from 

a Battle-Scarred MMO Veteran”, the book outlines not just how to create, build and 
maintain a successful guild but also how to lead it to glory. Andrews should know, 
because he leads one of the oldest-surviving guilds in World of Warcraft. He shares secrets 
from his long experience to illustrate how to plan successful raids, player vs. player battles, 
role-playing sessions and contests; deal with problem players and keep a lid on guild- 
fracturing drama; solve loot issues and choose the best loot system; boost morale, 
reputation and server presence; and promote and motivate an effective officer corps. 
The Guild Leader’s Handbook is published by No Starch Press. 


www.nostarch.com 
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NEW PRODUCTS 


Imsys’ SNAP Classic 


The Swedish firm Imsys proudly announced a new generation of its SNAP Classic module, a drop-in replacement 
for the DSTINI390 reference design—a Java-based networked controller. Using the same module size and 
interfaces, the SNAP Classic provides all interfaces supported on the TINI platform. The new SNAP Classic offers 
greatly improved performance while reducing cost and power consumption, retaining all the legacy and adding 
new compelling features. For heavy-duty, floating-point computations, SNAP Classic now offers a performance 
increase of more than 200 times that of TINI, says Imsys. A “crypto engine” consisting of 27 new opcodes 
supports ARC4, DES, AES, RSA, MD5, SHA1 and SHA256, accelerating them by a factor of up to 43 times 
compared to their C code implementations on the same processor. For development, the SNAP Classic user 
can use either free Java tools or purchase the optional Imsys Developer, a professional IDE that enables the 
developer to use a mix of Java, C and assembler programming. 


www.imsystech.com 


Mobile Edge ScanFast Laptop Cases 


From the “Not Just for Linux Geeks Desk” comes Mobile Edge’s new ScanFast line of laptop 
carrying cases and accessories, which the producer claims to be “the first TsA-Compliant 
Netbook case collection on the market”. ScanFast is targeted at Netbook owners seeking 
a case more substantial than a simple sleeve and encompasses the Edge Netbook Briefcase, 

Messenger Bag and Backpack products. Each product has the additional advantage of being 
checkpoint-friendly at airports. To be checkpoint-friendly, TSA requires laptop compartments 
to be independent and clear of any other gadgets, cords, metal zippers and so on, and 
screeners must have a clear unobstructed view of the laptop itself. The cases support notebooks up to 13.3" (34cm) wide. 


www.mobileedge.com/scanfast 


DVEO’s eYeCatcher ATSC-M/H 


DVEO is now shipping the new eYeCatcher ATSC-IM/H, a compact test modulator 
for emulating Mobile DTV (digital TV) signals. Designed for use in development 
labs and for technology demonstration purposes, the eYeCatcher ATSC M/H is a 
portable frequency agile modulator with IP, ASI or SMPTE 310M input and ATSC 
M/H output. It delivers real-time or stored video to cell phones, PDAs, handhelds 
and vehicles. The device is ideal for laboratory applications, testing set-top boxes 
and mobile devices, and in-store demonstrations of ATSC M/H devices. 


www.dveo.com 


Undo Software UndoDB 


The Cambridge, UK-based Undo Software bills the new version 3.0 of its reversible 
debugger for Linux, UndoDB, as “a huge step backwards”. UndoDB’s reversible 
debugging capabilities (also known as replay or historical debugging) allows a 
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int 
main (void) 


developer to step or run an application backward and answer the real question 
when debugging: “How did that happen?” The Undo folks say that UndoDB 
3.0 can debug nearly any Linux process, including those using multiple threads, 
asynchronous signal handlers and shared memory. The new edition also is reputed 
to be faster than ever, running applications with a slow-down of just 1.7x 
while still keeping full visibility of the program's entire execution history. Finally, 
UndoDB 3.0 supports reverse watchpoints, allowing programmers to find the 
root cause of elusive memory-corruption bugs easily. 


undo-software.com 


int a, b, c; 
a=3; 
b=4: 

c = arb; 


return; 


U/home/gel /tests/simple.c:5:35:beg:0x8048348 
(gdb) graph display a 

(adb) graph display b 

(qdb) graph display c 

(gdb) : 


AN 8: ¢ (enabled, scope main, address Oxbfide7cb4) 


Please send information about releases of Linux-related products to newproducts@linuxjournal.com or New Products 


c/o Linux Journal, PO Box 980985, Houston, TX 77098. Submissions are edited for length and content. 
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Fresh from the Labs 


MilkyTracker—Open 

Music Tracker 
www.milkytracker.org 

Fans of musical tracking programs, such 
as Fasttracker, ProTracker, CheeseTracker 
and the like, will want to check out 
MilkyTracker, which has been quite pop- 
ular on SourceForge and has had pretty 
widespread distro integration of late. To 
quote MilkyTracker’s documentation: 


MilkyTracker is an open-source, 
multiplatform music application, 
more specifically, part of the 
tracker family. It attempts to 
re-create the module replay and 
user experience of the popular 
DOS application Fasttracker II, 
with special playback modes 
available for improved Amiga 
ProTracker 2.x/3.x compatibility. 


Installation When it comes to 
installation methods, you are pretty 
spoiled for choice. Along with the usual 
source tarball, packages in various 
repositories are available for Ubuntu, 
Arch Linux, Debian, Enlisy, Gentoo and 
SUSE, as well packages for our FreeBSD 
and OpenBSD cousins. Ubuntu users 
are doubly spoiled with a binary tarball 
built upon Karmic. 

For those who are running with 
source, according to the documenta- 
tion, MilkyTracker can be compiled 
using the standard ./configure; 
make; make install (note that 
make install requires the use of 
root or sudo). However, | ran into 
compilation problems during the 
“make”. | hope you have more luck. 
| went with the binary tarball in the 
end, which ran with no problems. 

As far as libraries go, there shouldn't 
be too much in the way of strange 
requirements, although | did need to 
install libzzip-dev and libsdl1.2-dev to get 
past the source code’s configure script. 

Once your installation has finished, 
run MilkyTracker with: 


$ milkytracker 


MilkyTracker’s capabilities. Click 
the Load button in the cluster of 
gray buttons near the top left of 
the screen, navigate to the direc- 
tory in which MilkyTracker has 
been installed, and look at the 
songs directory. Choose one of 
the available tracks and click Play 
Song on the bottom-left corner of 
the main cluster of gray buttons. 
My personal favorite (or at least 
the most credible of these 
tracks—demonstration songs are 
always pretty dry) is “slumberjack”, 
which is nice and progressive and 
shows off MilkyTracker's capabilities 
quite nicely. 

As the track plays, you'll see a 
bar move rapidly down the main 
composition screen's page and 
move on to other pages of music 
as the song progresses into new 
movements. A welcome feature 
from classic tracker programs is 
the wave visualization inside those 
windows in the middle section. 
They give individual readouts for 
each channel. It’s pretty cool to 
watch this multitasking in progress 
and see the music's very DNA scroll 
before your eyes. 

| also noticed a very willing use 
of the stereo spectrum in this pro- 
gram, which helped to add spice. 
That said, my favorite part of this 
project is the sample editor, which 
lets you manipulate waveforms by 
hand. It also lets you literally draw 
your own waveforms—effectively 
making something from nothing. 

However, none of this stuff 
will come as a surprise to tracker 
veterans, who've grown up with 
such hard-core features since the 
days of DOS. Newbies who are 
used to soft-core programs like 
FruityLoops will freak out in this 
imposing retro environment. 
Veterans probably will rejoice in 
the imposing low-level interface 
and go back to skulking around 
in their basements listening to 
Kraftwerk and Wumpscut. 
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MilkyTracker provides all the old-school, low-level 
control from ye olde days of music tracking. 
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You don’t get much more hard core than waveforms 
drawn by hand! 
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Thankfully, a keyboard-based instrument editor is 
included as well. 


grams, while adding more modern 
capabilities and platform diversity. | 


Usage The first thing | recommend 
doing is loading some of the provided 
songs, which instantly will show off 


Ultimately, MilkyTracker provides 
an authentic environment for those 
who have grown up with these pro- 


personally find these programs way 
too daunting, but old-school Tracker 
fans are going to love it. 


42 | june 2010 www.linuxjournal.com 


Paintown—2-D Arcade 
Fighting Engine 
paintown.sourceforge.net and 
freshmeat.net/projects/paintown 

Before | begin, there’s been some recent 
controversy over this project, with the 
accusation that this project is ripping 
off someone else's work. Playdeb.net 
was sent the following message from 
the Senile Team: 


It may interest you to know 
that Paintown “borrows” orig- 
inal work from Senile Team 
without permission. To put it 
more bluntly, Paintown is a 
rip-off from Beats of Rage 
(see www.senileteam.com/ 
beatsofrage.html). 


The source code and assets for 
Beats of Rage are freely available, 
and may be used by anyone— 
provided of course that they give 
proper credit. The author of 
Paintown, however, has openly 
refused to do so, and Paintown 
should, therefore, be considered 
in violation of copyrights. 


The author of Paintown has on 
several occasions been confronted 
with the impossible similarities 
between “his” game and Beats 
of Rage. However, rather than 
admitting to the obvious, he 
instead decided to alter some of 
“his” code and assets in order 
to hide their true origin. And yet 
even now, the screenshot seen 
on your site immediately betrays 
Paintown as a rip-off, containing 
several custom graphics that 
were made by Senile Team. 


| had already written this month’s 
piece when | received this information, 
and Playdeb.net took down the pack- 
age (although things may change by the 
time this article is printed). However, | 
feel it's best to pass on this information 
and let you decide for yourself. 

This is not my genre of gaming and 
I'm far from an expert, but this project 
instantly caught my attention and 
seems to have a great deal of potential. 
To quote the Web site: 


Paintown is a 2-D engine for 
fighting games. If you are looking 


for a side-scrolling, action- 
packed game like you used to 
play, or if you are looking for an 
extensible engine to write your 
own game, look no further. 
Paintown supports user-created 
content through a mod system 
and user-defined functionality 
through scripting. 


Paintown also supports an 
implementation of M.U.G.E.N. 
Our goal is to be 100% compat- 
ible with M.U.G.E.N 2002.04.14 
beta as well as supporting any 
new updates in the 1.0 version. 


Paintown is completely open 
source, and we would love any 
contributions in the form of 
code, art or donations. Give 
Paintown a try! 


Paintown has the following features, 
according to the Web site: low CPU and 


GPU requirements, network play, 
dynamic lighting, joystick support, 
mod/s3m/xm/it music modules, scripting 
with Python and the M.U.G.E.N engine. 
Installation and Usage At the 
Web site, a source tarball was (supposedly) 
available, but | ran into some trouble with 
it. The Web site link wasn’t working at 
the time of this writing, and it gave an 
error. However, the link from the project's 
Freshmeat page was working fine. I'll leave 
the rest of the installation details to you 
on this one, as things seem to be a bit 
up in the air with this particular project. 
Inside the game, things are fairly 
intuitive, but documentation for some 
of the finer details is lacking, so please 
forgive me if | make some dumb errors. 
There are three main components: 
Adventure Mode, Adventure Mode 
with Computer and M.U.G.E.N mode. 
Adventure Mode puts you in a sideways- 
scrolling street-brawl game, with 
changing scenery and characters in the 
style of Final Fight, Double Dragon and 
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2010s Well, why not? Streamline your business 
operations utilizing the always-on, redundant 
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and fully scalable cloud architecture. 


CariNet's "Starter Cloud" running 3tera's® 
AppLogic™ Cloud OS includes 5 one-on-one 
training sessions with our cloud-certified P 
experts to get you up to speed. , 


Cloud is no longer just a buzzword, but is here 
to stay. Don't get left behind. Find out what 
the excitement is all about risk-free with 
CariNet: the Cloud Computing Specialists. 


carinet 
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No Contract, No Risk! 


www.cari.net/LJ 
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Paintown can be a bit intense, with lots of giblets, spinal cord and whatnot. Don’t tell Mum though. 
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How many commercial games would let you team up Donatello with Wolverine, eh? 


so on. Adventure Mode with Computer 
adds a computer-controlled Player 2, 
and you can assign a different character 
to each player. 

The beauty of a noncommercial 
game such as this is that fans generally 
add their favorite characters from other 


games, and here you can choose from 
such characters as Ryu and Blanka from 
Street Fighter, Goku from Dragon Ball 
and even the time-honored Wolverine! 
Each character has different strengths 
and weaknesses, and Attack buttons vary 
between them all. Nevertheless, there are 
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similarities between most characters: 
Attack 1 usually is punch, Attack 2 is 
a kick, and Attack 3 generally grabs an 
opponent. A character may have only 
one Attack button in use, but that 
Attack will be particularly devastating. 
Or, all three Attack buttons will be used, 
but with less power in each, although 
a more even spread. 

Now let's look at M.U.G.E.N mode. 
For those not in the know, M.U.G.E.N 
was a 2-D fighting game built around 
customization, creating characters, 
background stages and so on. It 
spawned a community all its own 
with versions for DOS, Windows and, 
thankfully, Linux. These communities 
still are running strongly today with 
extraordinarily dedicated projects, such 
as the Infinity M.U.G.E.N Team's highly 
ambitious Marvel vs. Capcom, which is 
an entire gig’s download! 

As for Paintown’s M.U.G.E.N game, 
it’s very basic and rudimentary, with only 
one character from which to choose and 
fight against, with some joking cutscenes 
before and after playtime. Promisingly 
enough, it does have a training mode, 
as seen in the later years of this genre, 
so | look forward to seeing how things 
progress, given the attention to detail. 
Unfortunately, I'm out of space, so 
| can't really give it the coverage it 
deserves. | also didn’t get a chance to 
look at the multiplayer networking side 
of things, but I’m sure it will make office 
lunch hours a good laugh! 

Although this is not really my genre, 
and I'm not comfortable with advocating 
violent video games, |’d be remiss in my 
duties to not report on it due to my own 
biases. The open framework of this 
project is marvelous, and its integration of 
M.U.G.E.N is all the better, which should 
breathe life into a genre that’s mostly been 
abandoned by mainstream commercial 
gaming. Plus, the noncommercial aspect 
allows fans to live out their gaming 
character fantasies that commercial 
licensing would simply not allow. 


John Knight is a 25-year-old, drumming- and climbing-obsessed 
maniac from the world’s most isolated city—Perth, Western 
Australia. He can usually be found either buried in an Audacity 
screen or thrashing a kick-drum beyond recognition. 
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Pogoplug 


Pogoplug, the easiest file server you'll never set up. MIKE DIEHL 


I’m sure I'm not the only one who is apprehensive about 
uploading family pictures and home movies to on-line services 
like Facebook or YouTube. As we all know, once something is 
on the Internet, it’s out of our control, and who knows where 
it will turn up next. On the other hand, the Internet is a great 
way to share media with friends and family. The more technically 
savvy among us certainly can figure out how to host media 
on servers that we control, but most people need a box 
they can plug in that “just works”. And, that’s what Cloud 
Engine’s Pogoplug does. 

The Pogoplug is a box the size of a Wi-Fi router that has 
a Gigabit Ethernet port and four USB ports (one on the front 
and three on the back). Inside is an ARM processor running 
Linux kernel version 2.6.22—all this, and it’s pink! Yes, | said 
pink. The case is white with a clear acrylic shell, trimmed in 
pink, with a cable management clip in the back of the device. 
Overall, it's rather Apple-esque (Figure 1). 


Figure 1. Pogoplug (from Cloud Engine’s Web site) 


My review unit came with a bag of microwave popcorn 
and a simple note saying to go start the popcorn, then come 
back and follow the Pogoplug setup instructions. The note 
boasted that the Pogoplug would be ready before the 
popcorn, and it was. Once | connected power, networking 
and a USB hard drive, which | happened to have on hand, 
all | had to do was go to my.pogoplug.com and enter the 
device's ID, my e-mail address and a password. A couple 
seconds later, it was ready to go. From that point on, all 
| had to do was supply my e-mail address and password to 
access the device. This is the kind of simplicity most people 
expect from consumer electronics. 

Once the device finished booting, it began scanning the 
attached storage for pictures, movies and music files. It wasn't 
long before | was uploading media to the device and making 
it available to various friends and family. At this point, it 
was all pretty intuitive, though by no means sophisticated. 
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| was able to grant either read-write or read-only access on a 
directory basis—real simple. When | granted access to people, 
they received an e-mail message telling them how to access 
the shared media. When my friends clicked on the hyperlink, 
they were able to preview or download various files | had 
made available to them. From their points of view, it was 
just another Web page; from my point of view, it was a server 
that | controlled. 

All interaction with the Pogoplug is through a single 
Web site, my.pogoplug.com. This Web site is able to 
access your device, or devices, and present you with an 
easy-to-use Web interface. You don't even need to know 
your device's IP address (Figure 2). In the center of the 
page, you see thumbnail previews of some movies and a 
music file that | uploaded. When you mouse over a thumb- 
nail, a pop-up menu appears that lets you either preview 
(Figure 3), download or remove the file. Along the left side 
of the page, under My Media, are various media categories. 
These links simply show a filtered view of all of the files 
on the device. Under Show my files, there are a few other 
ways of accessing media files on the device. Maybe it's 
the nerd in me, but | prefer to access the drives directly, 
from the My library section. Here, | have two thumbdrives 
plugged in (middle left-hand side of Figure 2). 
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Figure 2. Web Interface to Pogoplug via my.pogoplug.com 


Across the bottom of the page are buttons that allow you 
to change how the device displays your file lists, as well as 
buttons that let you upload new files, create folders and copy 
files from one folder to another. There's also a Sharing button. 
This is the button you press when you want to grant other 
people access to a directory. 


Peed 10.03.52 - 


Figure 3. Previewing an Image 


When you click on the Sharing button, you are presented 
with a screen that allows you to turn sharing on or off for 
the current folder. If sharing is on, you can invite people 
to access the share. Also, you can see who has access, and 
whether it’s full access or read-only access. Additionally, this 
is the screen where you configure the social-networking 
features of the Pogoplug. 

Most of my friends and family use Facebook to keep in 
touch, so | was intrigued to hear that the Pogoplug would 
integrate with Twitter, Facebook and MySpace. | decided to 
check out the Facebook feature. Once | supplied my Facebook 
user name and password, the device posted a news article 
to my “wall” any time | added files to the shared directory. 
Obviously, this would be a great way for the grandparents to 
keep up with all the grandkids. 

Okay, so how does it work, really? As soon as the 
device boots up, it calls home via what looks like a TCP- 
based VPN. From that point, the device is able to respond 
to commands, such as “Tell me what services you are pro- 
viding” or “Delete a file.” It’s important to note that this 
is a free service, and that your files stay on your device and 
don’t simply get uploaded to Cloud Engine'’s servers. But, 
one of the nice things about this architecture is that the 
Cloud Engine Web site is a central point of interaction 
with your Pogoplug device, or devices. This also enables 
you, the consumer, to write Web service requests from any 
Web page that can interact with your Pogoplug (I'll come 
back to this in a minute). 

The dark side of this architecture is that cloud comput- 
ing could become a potential single source of failure. If 
Cloud Engine went out of business, this infrastructure 
would go away also. However, to mitigate this threat and 
to dissuade fears, Cloud Engine has put its source tree in 
escrow to be released to the public if need be. In the 
meantime, Cloud Engine uses this infrastructure to distin- 
guish its product from other similar devices. In fact, chatter 
on the Pogoplug user forums indicates that the infrastruc- 
ture is being developed and improved actively. What I’ve 
gleaned from reading the forums is that Cloud Engine can 
push upgrades to the device—meaning that the Pogoplug 
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is basically a managed device, but the owner maintains 
complete control. 

Sadly, the device doesn’t ship with a native Samba or NFS 
server. The device is targeted at people for whom this much 
configuration would be too much. But, there is a filesystem 
driver available for download that runs on Linux, Windows 
and Mac. | installed it on my Linux workstation and my wife's 
Windows laptop, and it worked quite well. 

So although the device is designed simply to work right 
out of the box with little or no configuration, it still is quite 
hackable by more sophisticated users. However, you first have 
to determine what the device's IP address is, and this isn’t to 
be found anywhere on the device’s Web site! | had to ask my 
DHCP server. Armed with the IP address, | was able to ssh into 
the machine as root using the default password, ceadmin. This 
is a reasonably secure configuration, because presumably, 
the device will be behind your NAT router and not accessible 
from the outside world. However, I’m told that after March 
16, 2010, SSH will be turned off by default, but users will 
be able to enable it through the Web interface. 

Earlier, | alluded to the ability to send Web service requests 
to a Pogoplug. Cloud Engine’s Web site documents how this 
is done and provides a fairly complete API for interacting with 
a Pogoplug. With a little bit of reading, | was able to perform 
some basic functions in only a few minutes. 
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First, you have to authenticate via the service.pogoplug.com 
Web site. This is done by sending an HTTP GET request with 
this structure: 


http://service.pogoplug.com/svc/api/ 
»>LoginUser?emai L=user@example.com&password=supersecret 


You can see that the only parameters are your e-mail 
address and the password you use to access the device. The 
server will reply with a JavaScript object that contains various 
pieces of information, including a valtoken field, which 
contains an authentication token. You simply include that 
token in subsequent requests, such as: 


http://service.pogoplug.com/svc/api/ 
=>ListDevices?valtoken=5LfDTCKNZRoi86I fdd 


This request results in another JavaScript object detailing 
the hardware that’s plugged in to my device: 


{"devices": 
[{"deviceid" — :"UZHTREWJF52ZMN" , 
"type" :"xce:unknown", 
"name" :"Pogoplug", 
"version" :"LINUX POGOPLUG - 2.0.3", 
"flags" "8", 
"ownerid" :"228d65951f3felff6c", 
"owner" 
{"userid" :"228d6felff6c", 
"screenname" :"user@example.com", 
"email" :"user@example.com", 
"flags" :"sawoobe, gv=m,", 
"emails" :[{"address" :"user@example.com", 
"validated" :"1", 
"default" Os 
"options" :[{"name" :"disablehoverprev", 
"value”™ "1"};, 
{"name" 
"slideshare_4dDxYuUonfJQ"}]}, 
"sku" 2{"skuid" "3", 
"oem" :"Cloud Engines", 
"name" —:"POGO-TEST", 
"user" : "Pogoplug", 
"terms" :"Q"}, 
"terms" iS a 
"valstart" Os 
"valend" i 
"services" :[{"deviceid" :"UZHTRETF52ZMN" , 
"serviceid" "Y¥xg9F32P-mcuVZIIZRKRAQ", 
"sclass" Sue Ba 
"type" :"xce:plugfs:vfat", 
"name" "KINGSTON", 
"version" :"LINUX POGOPLUG - 2.0.3", 
"online" a baa 


"msgpending" :"0", 


"apiurl" “http: /710:0..1,,52°3333/ 044". 
"space" :"1358462976/ 1999044608" , 
"flags" 2"12288"}1}1} 


You can see that it would be pretty usable inside a 
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JavaScript program. | haven't looked at the API documentation 
with an eye toward writing a particular application, but it 
seems pretty complete and well documented. 

As is, the Pogoplug is a simple file server, but thanks to 
OpenPogo (which is now known as PlugApps), you actually 
can extend the device's functionality. By default, the root 
filesystem is mounted read-only, but once the filesystem is 
remounted read-write, you can mount an attached USB hard 
drive manually. Then, you download the PlugApps tarball and 
extract it onto the mounted filesystem. 

Once PlugApps is installed, you can install additional 
packages using the ubiquitous ipkg package manager. 
From here, it's pretty easy to imagine a Samba, Firefly or 
CUPS server running on the device. But, the neat thing 
about the way the installation is done is that it doesn’t 
overwrite the existing filesystem. This means you don’t lose 
any of the benefits of the Cloud Engine infrastructure. 

Overall, | think the Pogoplug is a neat little device, but it 
does have some negatives. | was really hoping to be able to 
plug in my digital camera and have the Pogoplug recognize 
it as a regular USB hard drive and publish my pictures. This 
would have been a great way to offload photos and make 
them available to friends and family in one operation. Alas, 
that didn’t work, but it probably has more to do with my 
camera than the Pogoplug. When | pulled the memory card 
out of the camera and put it in a USB card reader, it worked 
like a charm. 

By itself, the device is very attractive-looking. However, all 
of the equipment in my LAN closet is black, as is most of the 
equipment on my desk in my office. Even my entertainment 
system is black. Against these black backgrounds, this pink 
Pogoplug kind of sticks out like a sore thumb. This leads me 
to wonder how hard it would be to offer different colored 
skins for the device. I'd snap up a black skin in a heartbeat, 
although I’m sure other designs, such as camouflage, might 
be popular. On the other hand, | have to admit, it is quite 
the conversation piece. 

The configuration was designed to be simple, and I'd 
venture to say that it actually might be too simple. I'd like to 
be able to associate comments with the various files | upload. 
Also, the categories Movies, Photos, Music and Slideshows 
are a bit limiting, as | also have documents and spreadsheets 
that | share. Finally, the ability to organize my music collection 
better would be very much welcome. 

That said, the Pogoplug is an extremely easy device to set 
up and use. This $130 device eliminates virtually all the hassle 
of sharing media, controlling access and telling my friends and 
family when I've uploaded new baby pictures, for example. My 
plan for the device is to tuck it away in the corner of my LAN 
closet and post some shares for family pictures. I'll also post a 
share for just our immediate family, where we'll store genealogy 
data that my wife can collaborate on with her father on the 
other side of the country. I'll probably also set up a share for 
my favorite YouTube videos. With the Pogoplug in place, my 
wife and kids may not have to interact directly with my main 
server anymore, but they'll still have convenient access to 
the stuff they want.m 


Mike Diehl is a contract programmer and consultant in Albuquerque, New Mexico. Mike lives with 
his wife and three small boys and can be reached via e-mail at mdiehl@diehlnet.com. 
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DISTRIBUTIONS 
A BRIEF HISTORY 


Add one part GNU, one part Linux kernel, stir lightly, 
bake for 19 years, and you get 452 different meals. 


JES FRASER 


t seems as though there are as many 

Linux distributions as there are letters 

in the alphabet with which to name 
them. Certainly, there is a flavor to satisfy 
almost any palate. It wasn’t always this 
way, however. How did it happen? Why 
hasn’t the Linux world just standardized 
on a single distribution? 


50 | june 2010 www.linuxjournal.com 


www.linuxjournal.com june 2010 | 51 


FEATURE Distributions—A Brief History 


The beginning of the Linux distribution really started with Richard 
Stallman and his fledgling Free Software Foundation in the early 
1980s. The GNU operating system was being developed, intending 
to re-implement a UNIX-like operating system as free software. 
Although many GNU tools enjoyed wide use, the project suffered 
various setbacks and delays in its hunt for a kernel. There was a lack 
of cooperation from some at Berkeley with using the BSD kernel, and 
there were licensing issues with Mach (Carnegie-Mellon University’s 
microkernel). Before these issues were resolved and the GNU Project 
was able to make headway building its own kernel, Hurd (another 
free kernel) became available for use. Then in 1991, the following 
message appeared on a Usenet newsgroup groups.google.com/ 
group/comp.os.minix/msg/b813d52cbc5a044b?pli=1: 


Hello everybody out there using minix- 


I'm doing a (free) operating system (just a hobby, won't be 
big and professional like gnu) for 386(486) AT clones. This 
has been brewing since april, and is starting to get ready. I'd 
like any feedback on things people like/dislike in minix, as 
my OS resembles it somewhat (same physical layout of the 
file-system (due to practical reasons) among other things). 


I've currently ported bash(1.08) and gcc(1.40), and things 
seem to work. This implies that I'll get something practical 
within a few months, and I'd like to know what features 
most people would want. Any suggestions are welcome, 
but | won't promise I'll implement them :-) 


Linus 


(PS. Yes - it’s free of any minix code, and it has a multi-threaded 
fs. It is NOT protable [sic] (uses 386 task switching etc), 
and it probably never will support anything other than 
AT-harddisks, as that’s all | have :-( 


Linux provided a stopgap measure for the free kernel GNU 
needed to be a complete operating system. Because Linux was no 
more and no less than a kernel, it similarly needed tools like those 
provided by GNU and other projects to be usable by anyone other 
than a developer. Early enthusiasts put together bundles of software 
running on the Linux kernel, creating the first distributions. These 
early distributions were mostly created by universities for internal 
use, some releasing their handiwork to the wider community. 

With Linux 0.12, Linus announced his intention to license the 
kernel under the GNU GPL (General Public License). Achieved by 
the release of Linux 0.99, this removed the prior restriction on 
commercial distribution, paving the way for commercially backed 
distributions that were soon to come along. 

One of those was Soft Landing Systems’ SLS Linux, one of the 
first widely used distributions. It was installable by floppy disk and 
included such cutting-edge features as TCP-IP networking support 
and the X Window System. SLS enjoyed popularity for the time, 
but it came under criticism for being buggy and unstable. When 
Soft Landing Systems announced it was going to change the 
default binary format from a.out to ELF, it met with a very 
negative response from the user base. 

Among those upset by Soft Landing Systems’ decision was 
Patrick Volkerding, who then created a modified version of SLS 
he named Slackware. The first release was July 16, 1993, and 
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Slackware holds the honor of being the oldest currently maintained 
Linux distribution—by a few months. 

lan Murdock also became quite frustrated with the flaws 
he perceived in SLS, and he announced on the newsgroup 
comp.os.linux.development on August 17, 1993 
(groups.google.com/group/comp.os.linux.development/msg/ 
a32d4e2ef3bcdcc6): 


This is just to announce the imminent completion of a 
brand-new Linux release, which I’m calling the Debian Linux 
Release. This is a release that | have put together basically 
from scratch; in other words, | didn’t simply make some 
changes to SLS and call it a new release. | was inspired to 
put together this release after running SLS and generally 
being dissatisfied with much of it, and after much altering 
of SLS | decided that it would be easier to start from scratch. 


In the same year, lan Murdock released the Debian Manifesto, 
detailing his vision for a free and open distribution that would be 
developed and maintained communally. He saw such a distribution 
as the way to avoid stagnation, crucial to Linux’s success in the 
commercial market. The Free Software Foundation supported 
these efforts by funding Debian development for a year. 

Both Debian and Slackware were born of the dissatisfaction 
of not just the problems with SLS but the closed nature of the 
distribution preventing any improvements being submitted by 
the user base. lan Murdock’s solution of having a distribution 
where many hands made light work of high standards persists 
today, although Debian's development process has come under 
criticism for its long release cycles. 

Although Murdock built his solution on community involvement, 
Volkerding's response was almost the polar opposite. The Slackware 
team did grow to multiple developers; however, as late as 2000, 
all changes still were being signed off personally by Volkerding as 
the project's “czar”. This, he was recorded to have said, ensured 
that there was “...a high level of quality and consistency” (from 
http://slashdot.org/interviews/00/03/17/1120205.shtml). 

Red Hat Linux was another of the successful early distributions. 
Marc Ewing was developing software for the UNIX platform but 
turned to Linux as a more affordable option than a UNIX workstation. 
He found after a time that rather than work on his main project, he 
spent the majority of his time fixing issues with Linux. Marc eventually 
decided to put his original project aside and “...work on putting 
together a better Linux distribution” (http://www.salon.com/ 
tech/view/1999/10/04/marc_ewing) as a business venture. 

His first version took about a year and a half, and released in 
1994. Bob Young purchased most of the produced copies of the 
distribution for ACC Corporation, a mail-order business that sold 
Linux- and UNIX-related products, including distribution media. 
Not long after that, in 1995, Young bought Ewing's business 
and merged it with ACC to become Red Hat Software. That 
year, Red Hat 2.0 was released, including the then-new RPM 
package management system. Four years later, Red Hat bought 
and merged with Cygnus, becoming the largest open-source 
company in the world at that time. 

SuSE, standing for Software und System-Entwicklung in 
German (Software and Systems Development), originally started 
as a software development and UNIX consultancy company, con- 
sisting of its four founders Roland Dyroff, Thomas Fehr, Burchard 
Steinbild and Hubert Mantel. Their original business plan did not 


succeed, so SuSE moved on to distributing Linux. To start with, 
SuSE provided software packages and services based on SLS. 
Once Patrick Volkerding had created Slackware, SuSE began 
translating it into German. 

For some time, SuSE continued to translate and distribute 
Slackware, but for much the same reasons that Patrick Volkerding 
and lan Murdock became frustrated with SLS, SuSE grew dissatisfied 
with Slackware. Slackware’s closed development prevented 
SuSE from having its improvements and changes accepted. 
Disappointed by bugs it was unable to fix, SuSE decided to 
create its own Linux distribution. 

The SuSE team identified a need for an easy-to-use installation 
and configuration tool and started work on YaST, the core of 
modern SuSE Linux. Over time, SuSE incorporated many features 
of Red Hat Linux, including the RPM packaging system and the 
Red Hat-style rc system. 

Of course, both Red Hat and SuSE exist in somewhat different 
forms today. Red Hat eventually stopped supporting the free version 
of its operating system to focus on Red Hat Enterprise Linux, with the 
Fedora Project stepping in to maintain the community-focused distribu- 
tion. SUSE Linux went through a similar change not long after being 
acquired by Novell, with OpenSUSE rising as a new free and open 
flavor. Slackware and Debian have navigated the years more or less 
intact, with lan Murdock’s vision of Linux's commercial success realized 
not in Debian itself but in the one who was yet to come—Ubuntu. 

These are just the earliest distributions whose impact still 
clearly can be seen in the Linux world, with all of them featured 
on DistroWatch’s top ten distributions list (albeit with the 
metamorphosized forms Fedora and OpenSUSE). Many others 
were not as successful but also played a part in shaping the 
early face of Linux—bonus points to any readers who have been 
Linux users long enough to remember MCC or Yggdrasil. 

All four of the successful distributions had the common trait of 
providing a Linux distribution that was improved and easier to use, 
and all four of the distros discussed here were frustrated with their 
efforts at trying to contribute to the projects that had come before 
them. Ultimately, the story behind our myriad Linux distributions is 
like that of Linux itself: each was started by the most pragmatic 
kind of dreamer who could visualize a better way and had the 
talent and drive to make that vision real.m 


Jes Fraser is a Linux specialist from New Zealand. 
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PhiIiosophny 
and Fancy 


There are no rules about what you can and can’t do when you create your own 
Linux distro, but if you step back from the trees, the forest starts to emerge. 


DAN SAWYER 


ree and open-source software isn’t just a way of com- 
puting, it’s a way of life, right? Or, is it just a way to get 
cool free stuff? Or, is it the ultimate insurance against 
totalitarian government, corporatist/mercantilist rule? 
Or, maybe it's a toolkit that forms a common cultural substrate 
from which enterprises are built? Maybe not—l’m confused. 

Actually, this kind of confusion isn’t unusual for newcomers 
to the open-source space. Why in the hell would people 
release their software for free in the first place? Why would 
anyone want to use open-source software? What bearing do 
any of these questions have on choosing a distro? And, by the 
way, why do some distros strip the logo from Firefox or not 
include the ability to play DVDs or Internet videos? 

Sometimes in life, philosophy dictates reality rather than 
vice versa, and one of the areas where this is at least partly the 
case is in the packaging, design and distribution of free and/or 
open-source operating systems. 

What became the Open Source movement was born out 
of sixties and seventies radicalism, articulated by far-left 
quasi-Marxist anarchists like Richard Stallman, objectivist 
idealists like Eric Raymond, and colorful characters elsewhere 
along the political/philosophical spectrum. The idealism and 
the tensions that arose in that early hacking culture have 
gone on to infect the community at large and to affect the 
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business models of some of the largest tech companies in 
the world. Even when the philosophy hasn't, the amount of 
free software that’s simply lying around has turned into the 
DNA of much of the modern computing universe (Microsoft, 
for example, relies heavily on BSD code for its Windows 
Networking stack). Linux—perhaps partly because of the 
stated ideological neutrality of inventor Linus Torvalds and 
partly because of its broader popularity—can look like little 
more than a battleground for the different philosophical 
factions that gave birth to a number of major distributions. 
Some people even argue very loudly about whether the 
operating system we all love is Linux or GNU/Linux (speaking 
of which, those of you in the Stallman camp might want to 
start writing that hate mail now). 

It's hard to believe in this era of supposedly mindless 
consumerism that something as arcane as a philosophy can 
impact how your computer functions, but there you go. 
There are actually a few different arenas in which philosophy 
plays a major role in the design of Linux distributions— 
some of them coming out of the tensions outlined above, 
and some of them out of more practical kinds of paradig- 
matic considerations. To understand why Linux distributions 
are put together the way they are, it helps to understand 
these axes. 


MAJOR DIFFERENCES 

IN PHILOSOPHY 

These differences in philosophy directly 
impact distribution design decisions, leading 
to three major species of Linux distribution. 

The first species is the free distribution, 
and it follows the philosophy laid out by 
Stallman and his camp. This distribution 
accepts no patent-encumbered or commer- 
cial software, and it might not include hybrid 
software released under licenses like the 
LGPL or the Mozilla Public License. The Free 
Software movement initially arose in the 
1970s and 1980s in the hacker culture, when 
people who owned computers were almost 
exclusively programmers and engineers. As 
commercial software came in with the dawn 
of personal computing, Stallman and his 
cohorts became concerned with their rights 
as users (a term which used to mean a lot 
more than it does now) and as programmers, 
so they founded the GNU Project, which 
eventually aimed to put together an entirely 
free (as in speech and as in beer) operating 
system. The GNU philosophy, articulated by 
the nonprofit Free Software Foundation and 
eventually embodied in the GNU General 
Public License, very cleverly uses copyright to 
subvert centralized control of information. 

Free distributions are sometimes so 
devoted to the free software model that they 
will strip the trademarked artwork from, for 
example, Firefox, and substitute it for some- 
thing more generic, in order to avoid having 
to deal with trademark legalities or other 
issues that might complicate the licensing 
of the distribution as a whole. Fedora Core 
and Slackware are prime examples of 
distros that follow this philosophy. 

The second species is the commercial 
distribution, much maligned by the first 
camp. This sort of distribution takes advan- 
tage of the fact that the GNU GPL allows 
for commercial packaging (so long as the 
source code also is made available) and 
leveraging of GNU software together with 
various commercial and quasi-commercial 
programs to create a distribution that 
attempts to perform at the level of compet- 
ing commercial operating systems and tends 
to aim for the same space. These often will 
have bundled proprietary tools, or a propri- 
etary overlay with the system management 
tools, and generally will be licensed under a 
catchall proprietary license with a note that 
much of the included software is GPL, LGPL 
or another free license, but that the propri- 
etary tools and software are not covered by 
conventional open-source thinking. Thus, 
caution is warranted when modifying or 


redistributing the operating system. SUSE is 
a currently viable commercial distro. 

The third major species is the hybrid 
distribution, and its approach tends to be 
very pragmatic rather than ideologically 
slanted either toward the Free Software 
movement or toward commercial operating 
systems. These are the distributions that 
slant heavily in favor of free/open-source 
software, but still include (either bundled or 
via easily downloaded add-ons) proprietary 
fonts, codecs and other goodies of a legally 
murky nature (such as DVD ripping and 
decryption software) that often are not 
included in or available for commercial 


that some, or most, Linux distributions 
would follow this network-centric 
philosophy. Time-share computing and 
time-share-with-a-fresh-coat-of-paint 
(that is, Cloud Computing) are the major 
paradigms of the network-centric distribu- 
tion. Two others are cluster-based computing 
and dumb terminals running remotely off 
a central server (both useful in scientific 
and commercial environments). Some 
flavors of Red Hat are specifically tailored 
to this computing model. 

On the flip side, we have the desktop 
distribution. This is the operating system for 
the personal computing revolution. It stores 


Sometimes in life, philosophy dictates reality 
rather than vice versa, and one of the areas 
where this is at least partly the case is in the 
packaging, design and distribution of free 
and/or open-source operating systems. 


distributions short of compiling them oneself. 
This type of distribution is a recent arrival 
on the scene. Throughout the late 1990s 
and early 2000s, distros tended to be pack- 
aged either as commercial software or as 
free software + support, and sold in soft- 
ware boxes in computer shops. The burst 
of the dot-com bubble and the rise of 
widespread broadband, coupled with the 
legal problems caused by the DMCA, created 
a demand for distributions that delivered 
the benefits of free software with the func- 
tionality of commercial software, all while 
insulating distributors from the legal prob- 
lems associated with patent infringement 
or enabling copyright circumvention. As a 
result, this last variety has become the most 
popular, although the other two species 
definitely are still around. Mandriva and 
Ubuntu both fall solidly in this category. 


MAJOR DIFFERENCES 

IN APPROACH 

Fights between licensing philosophies 
are not the only issues that help shape 
distributions. There's also the question 

of computing models. Sun Microsystems 
(which started life as Stanford University 
Networks) used to maintain that “The 
network is the computer.” Because Linux 
is descended from System V UNIX—via its 
dependence on innovations made by the 
Berkeley Software Distribution (BSD)—and 
UNIX always has been a network-centric 
operating system family, it makes sense 


the operating system and all the user's data 
locally (while the network-centric system 
prefers the opposite). These distributions 
are usually general-purpose, including a 
selection of software that can meet almost 
every need, from setting up a home Web 
server to running a small business, from 
playing games to Web browsing and word 
processing or producing a podcast. The 
desktop distribution is the Swiss Army 
knife of Linux distros. Ubuntu, SUSE and 
Mandriva show this approach in action. 
You can see a vestige of the early 
heritage of your particular distribution by 
looking at the filesystem structure. Does 
your package manager install software to 
/usr/local/* or to /usr/*? If the former, your 
distro probably started life as a network- 
centric operating system for an office 
environment. If the latter, your distro has 
probably been designed (or, in some cases, 
redesigned) with the desktop in mind. 
Alas, there are some things for which 
the Swiss Army knife just isn’t suited, 
and in the last four years, several custom- 
purpose distributions have come on the 
scene to solve the shortcomings of the 
desktop distribution for different specific 
purposes. The most obvious of these are 
the studio distributions, customized for 
real-time audio and video production in high- 
demand environments, but there also are 
customized distributions for firewalls, Web 
servers and laptops as well as market- 
specific distros targeting churches, activist 
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groups, hackers and crackers, and 
grandparents (that is, users who are 
incapable of interacting with their machines 
as anything other than appliances). 

Moving beyond the customized distro 
space, there’s an entire field of customized 
Linux distributions that deserves special 
mention: the live CD. Knoppix was the 
first mover here, and since then, the space 
has exploded. With a live CD, you can run 
Linux on almost any hardware, including 
the programs you use most often (if one 
live CD doesn’t have it, chances are another 
probably will), without touching the 
machine's hard drive. Live CDs are very 
useful for diagnostics, for testing whether 
a distribution will play nice with your hard- 
ware or for taking a familiar environment 
into hostile territory (for example, when 
visiting relatives whom you don’t want to 
find out that you like visiting dolphinsex.com 
purely for research while writing your 
latest romantic epic about trans-species 
love among aquatic mammals). 

No discussion of the different approaches 
would be complete without mentioning 
embedded distributions—versions of Linux 
and derivative operating systems (such as 
RockBox and Android) designed to run on 
handheld devices, in networking appliances, 
NAS Servers and dozens of other gadgets, 
toys, tools and machines that consumers love 
to use and hackers love to repurpose. Some 
of these you can find for download on the 
Web, but a greater number are created and 
used in-house at different companies that 
manufacture devices of different sorts and 
often include a goodly amount of proprietary 
code to interact with the device's firmware. 


MAJOR DIFFERENCES 

IN ADMINISTRATION 

There's a third axis along which distributions 
sort themselves out, and that has to do with 
how you answer the question “Whose job 
is it to administrate the system?” 

Linux's architecture segregates system 
functions from user access—a major 
reason that Linux has proved remarkably 
insusceptible to viruses and worms. In a 
classical setup, what I'll call office adminis- 
tration, this means that only the root 
account can install and remove software, 
monkey with system settings, load and 
unload kernel modules, and change the 
hardware. A user account may merely use 
the software and access the data files 
generated by that particular user or shared 
with it by another user. This is still the 
most common setup, and it’s useful in 


small-office, home-office and family 
environments where more than one user 
will be accessing a given system regularly. 

However, laptops and Netbooks often 
don’t need this kind of strict segregation, 
because the user almost always also is the 
system administrator. Those distributions 
aimed at this market and at the single-user 
desktop operate according to a home 
administration model—that is, to remove 
the encumbrance of having to log in to 
root separately, a number of modern 
distros do not enable the root account 
by default. Instead, the primary user is 
also the sysadmin and must furnish only 
a password to perform administrative 
functions. Ubuntu and its derivatives use 
this scheme by default, although they 
easily can be converted to the more 
classical administration method. 

The final major administrative paradigm 
is Most commonly encountered in embedded 
systems and appliances. These gadgets, 
such as your trusty blue-box Linksys router, 
are generally headless and are administered 
remotely from a master system over SSH 
or (more commonly) through an easy-to- 
understand Web interface. 


MAJOR TYPES OF USERS 
The last axis that distributions tend to fall 
along isn’t exactly philosophical, but it still is a 
real consideration. If you're putting together 
a distribution, who is your end user? 

A distro put together for a hacker will, 
by default, install a raft of security-auditing 
and coding tools, and perhaps a handful 
of black hat tools as well, just for fun. 
These utilities almost always are available 
on other distros, but rarely do they install 
by default. Slackware is aimed squarely 
at this demographic. 

On the other hand, a distro designed 
with the end user in mind might install 
some games, an office suite, a media player 
or two and a handful of toys, but generally 
its goal is to not overwhelm users with 
options. Give users one tool that works 
reasonably well and a good package 
manager, and let people fill up the corners 
as they need to. A small footprint and an 
idiot-proof setup is the name of the game 
here. Xandros and Linux Mint are prime 
examples of this type of targeting success- 
fully taken to its logical extreme. 

Power users are another animal entirely. 
These users want to be able to tinker with 
the system right up to the end of their 
expertise, and one tool for one job is never 
enough. After all, when was the last time 
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you saw a perfect tool? Power users want 
it all and know how to milk the last bit of 
functionality out of their systems. They 
want an OS that is heavily optimized, that 
crashes rarely (if ever), and that they can 
control down to the process level without 
necessarily having to get their hands dirty. 
Systems designed for power users tend to 
be both slick and decadent, armed to the 
teeth with the kind of tools that would 
make most end users crawl into a straitjacket 
and whine for their mommies. The studio 
distributions, such as PlanetCCRMA and 
64 Studio, tend to be this variety. 

The administrator is the last major 
species of user, and distros designed for 
these users tend to be thin on flash and 
heavy on function. They also tend to run 
in environments where no end user would 
ever dare to tread, like server farms, 
render clusters and data centers. 


WRAPPING IT UP 

The plethora of Linux distributions can 
be enough to make anyone's eyes glaze 
over, and it's tempting (particularly for a 
newcomer to the F/OSS world) to chalk up 
the diversity in distro design as just another 
symptom of a fractious, political hacker 
culture with more time than sense. The 
reality is a little different. The axes outlined 
above demarcate the major design con- 
siderations that distro packagers have to 
weigh, and where you put your pin on 
each axis also generally will have knock-on 
effects in terms of what kind of hardware 
you want to support, whether and when 
you will ship kernel source, whether you 
ship with a modular kernel, what kind of 
package manager you'll use, and how 
you'll manage the community that springs 
up around your product. 

Likewise, understanding these consid- 
erations can help make the F/OSS space 
look a lot less like a battleground or a junk- 
yard and lot more like what it really is: a 
rich ecosystem, more than a bit jungle-like, 
of different designs evolving to serve different 
economic and ecological niches, always 
filled with interesting experiments—some 
of which succeed handsomely.m™ 


Dan Sawyer is the founder of ArtisticWhispers Productions 
(www.artisticwhispers.com), a small audio/video studio in the 
San Francisco Bay Area. He has been an enthusiastic advocate 
for free and open-source software since the late 1990s. He 
currently is podcasting his science-fiction thriller Antithesis 
and his short story anthology Sculpting God. He also hosts “The 
Polyschizmatic Reprobates Hour”, a cultural commentary podcast. 
Author contact information is available at www.jdsawyer.net. 
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options for running 
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housands of Linux distributions run on Intel-compatible x86 PCs, but these systems actually make up only a minority 
T of the computers produced. Other architectures, such as MIPS, SPARC, ARM, Power and Intel's Itanium chip are used 
heavily in certain applications. These computers historically have been the domain of high-end UNIX variants or specialized 
embedded operating systems, but Linux has taken both embedded systems and big-iron server systems by storm. In this 


article, | explain the important Linux distributions for ARM, IBM Power and Intel Itanium and their features. 
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ARM 

ARM is the world’s most-popular 32-bit 
processor. TVs, set-top boxes, portable 
devices and large numbers of other 
device categories contain ARM processors. 
They also are starting to be used in 
Netbooks due to the poor performance 
and high power consumption of the Intel 
Atom processor. ARM chips are popular 
due to their simple design, decent 
performance, low power consumption 
and for the massive amount of code that 
already runs on the architecture. 

Most ARM processors, especially 
lower-end ones, run tiny real-time 
operating systems like QNX and VxWorks. 
On higher-end devices, however, Linux 
is becoming a major player. Google's 
successful Android cell-phone OS is 
a Linux system, although a heavily 
customized one. Nokia also supports 
Linux on its high-end smartphones and 
Internet tablets with its Maemo operating 
system, a Debian derivative with hundreds 
of Linux programs ported to it. 

For hobbyists, the choice of distribution 
for ARM largely is defined by the 
available hardware. Most hobbyists do 
not have the time or resources to design 
their own Linux ARM board and develop 
a board support package for it, but a 
few hobbyist-friendly Linux hardware 
platforms have been developed. 

Starting with version 9.04, Ubuntu 
officially supports the ARM platform. 
Canonical releases images only for a 
fairly obscure Freescale development 
board, but the Linux community has 
created ports to numerous other ARM 
computers, including the BeagleBoard 
and the N800 and N810 Internet tablets. 
Sharp even released an Ubuntu/ARM 
Netbook in Japan, the PC-Z1 NetWalker; 
however, it received a poor reception 
due to substandard build quality and 
a miniscule optical trackpad. 

As Canonical is investing considerable 
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resources into the Ubuntu ARM port, 
it is expected to become significant as 
an OS for Netbooks and similar devices 
in the future. If you have compatible 
hardware, the Ubuntu ARM port is of 
very high quality. If you’re interested in 
experimenting but don’t have compat- 
ible hardware, Ubuntu also can be run 
in QEMU. Ubuntu’s wiki has tutorials 
for doing so, although the procedure 
is somewhat complicated. 

Quite a few mobile Internet devices 
and other small computer systems are 
using Ubuntu or Ubuntu variants as 
their default operating system, and 
you can expect Ubuntu for ARM to 
become even more important as 
Canonical invests more money into 
its continued development. 

Nokia’s Maemo platform has 
received quite a bit of attention lately. 
It originally was released on the company’s 
N770 tablet and was used by its 
successors: the N800/N810 Internet 
tablets and the N900 smartphone. 
Heavy interest developed in the platform 
after its use in the N900. Maemo is 
a full-featured Debian system with 
a custom user interface. It uses a 
stripped-down X server, KDrive and 
a touchscreen-friendly GTK-based 
desktop environment called Hildon. 
Nokia also provides Scratchbox, a package 
containing an SDK and emulator. 
Unlike most consumer embedded 
platforms, Maemo automatically 
can update itself with its APT-based 
package management system. 

Although Nokia supports Maemo 
only on its Internet tablet systems, 
its components are being ported to 
other operating systems and devices. 
A community project, Mer, exists to 
develop a new distribution based on 
code from both Maemo and Ubuntu 
and to port the new system to a wide 
variety of mobile devices with both ARM 
and x86 processors. Maemo 
probably still is a superior 
operating system on the 
Internet tablets due to its high 
level of completeness, but Mer 
is under heavy development 
and becomes more polished 
with every release. 

The Android operating 
system, developed by Google 
and its partners, is probably 
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Figure 1. Maemo Screenshot 


the fastest-growing operating 
system for smartphones and is 


The most popular ARM Linux 
distribution for hobbyists is 
Angstrém, built by a merger 

of several older embedded Linux 
projects. Angstrom uses a 
low-overhead package manager 
called ipkg, similar to the dpkg 
system used in Debian. An inter- 
esting feature of this distribution 
is the ability to generate a custom 
system image on the Web site, 
with user-defined packages and 
capabilities. During the past few 
months, developers have released 
plenty of software as Angstrom 
packages, including GNOME, 
Firefox, GIMP, Quake, Mono and 
dozens of other pieces of soft- 
ware. Angstrom also is used as 
the base for other embedded 
Linux distributions. 


becoming increasingly popular on tablet 
computers, such as the Dell Mini 5. 
Analysts predict that hundreds of 
millions of devices will ship running 
Android in the next few years, making it 
one of the most important embedded 
operating systems. Android runs a Linux 
kernel and has a basic shell, but in 
other ways, it’s very different from most 
Linux distributions. It uses a custom 
window system that’s very different 
from X11, which is what most users 
and developers are used to. It has a 
high-level application framework, 
WindowManager, that is backed by a 
low-level library called SurfaceManager. 
Android applications are written in Java 
and executed by the Dalvik Virtual 
Machine, which is designed to have 

a low memory footprint and lacks 
Just-in-Time Compilation, which is 

an optimization feature provided by 
most mainstream Java virtual machines. 
Clever developers and hobbyists have 
found that Android is easily tweakable, 
and have figured out how to run 
OpenSSH and X11 on the platform 
for those who prefer a more traditional 
Linux environment. 


PowerPC /Power 

The PowerPC architecture was jointly 
developed by IBM and Motorola around 
1990 and is used on a very wide range 
of devices. All three current major game 
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consoles use PowerPC-based processors, 
as do many routers, onboard computers 
in cars and aircraft, and high-end 
servers from IBM. Although PowerPC 
largely has faded from desktop computers 
since Apple switched to Intel x86 

in 2006, use of the processor for 
embedded and server purposes remains 
a multibillion-dollar industry. 

During the peak of PowerPC desk- 
top usage, most Linux distributions 
offered builds for the architecture. 
Sadly, this is no longer the case. Novell 
and Red Hat both offer Enterprise 
Server distributions for Power, but they 
aren't cheap and really are designed 
only for current IBM servers. Although 
their distributions are mature and well 
supported, most consumer PPC/Power 
hardware actually consists of older 
Macs and the EFIKA line of computers 
from Genesi. For these systems, the 
Enterprise Server distributions of SUSE 
and Red Hat Linux aren't really optimal. 
Thankfully, the Linux community still 
provides quite a bit of support for this 
architecture, largely due to the signifi- 
cant amount of inexpensive PPC 
hardware from before Apple’s switch 
to Intel. The Sony PlayStation 3 also 
has provided the Linux community with 
inexpensive, but powerful hardware. 
Its main limitation is the fact that it 
has only 256MB of RAM. 

Historically, one of the primary Linux 
distributions for PowerPC was Yellow 
Dog Linux. YDL is based on Red Hat 
Linux and uses RPM to manage packages. 
Its hardware support is generally quite 
good. The distribution runs on PowerPC 
Macs, IBM servers and workstations, 
and the PlayStation 3. YDL has some 
fairly significant differences from 
other distributions, such as using 
Enlightenment 17 as the default desktop 
environment. E17 offers quite a few 
advantages over both Enlightenment 16 
and conventional desktop environments. 
It’s far lighter on resource consumption 
than KDE, GNOME or Xfce, while 
offering a much larger feature set than 
most low-footprint window managers. 
Almost every element of the user inter- 
face is customizable with graphical tools 
and plugins. E17 also includes a built-in 
file manager, unlike previous versions. 
However, E17 still is under heavy 
development and may not be as stable 
as mature versions of GNOME or KDE. 
For users who prefer them, Yellow Dog 


also has packages 
for other desktop 


environments and 
window managers. 
Fedora also offers 
up-to-date PowerPC | 


ISOs of every version, 
including the latest, 
Fedora 12. Fedora 
offers a more 
complete default 
installation and more r 
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application packages, 
but also is considerably 
more resource-intensive. 
It attempts to give 

a GNOME or KDE 
environment comparable 
to the x86 build of the 
same version. This means if you're used 
to Linux systems on x86, you'll be more 
at home with Fedora than with Yellow 
Dog, but it also means it’s noticeably 
sluggish on older systems. Generally, I'd 
recommend Fedora for systems with a 
1GHz or faster G4 or G5, and at least 
512MB of RAM. It is important to 
note that support for Fedora on the 
PlayStation 3 is experimental and in a 
very early development stage, although 
there have been efforts to finish the 
port. Fedora 12 will be the last officially 
supported version for PowerPC, but 
there are efforts to provide community- 
supported PowerPC builds of Fedora 13 
and later versions. 

Ubuntu ended official support for 
PowerPC in late 2006 with Ubuntu 
6.10. Since then, there have been PPC 
builds of every Ubuntu release devel- 
oped by the community. These generally 
are very high quality and have excellent 
stability. Ubuntu has similar system 
requirements to Fedora, with most older 
hardware probably being too slow to 
handle it smoothly. Ubuntu also offers 
an ISO for the PlayStation 3, but it’s still 
experimental and somewhat limited in 
features due to the PS3's insufficient 
amount of RAM, so using the live CD 
is likely to be unpleasant. 


Itanium 

Itanium, also called IA64, was the last 
attempt by Intel to replace the aging 
x86 architecture, following the disap- 
pointing iAPX432 and i860 processors 
in the 1980s and 1990s. At one time, 
industry analysts considered it to be the 
future of the high-end servers, and Intel 


60 | june 2010 www.linuxjournal.com 


ms 
Figure 2. Enlightenment Desktop (E17) 


planned to use the architecture in 
personal computers eventually as well. 
Itanium uses a unique architecture, 
neither RISC nor CISC, that can execute 
several instructions per cycle in parallel. 
SGI and HP replaced their own high-end 
processors with Itanium out of the 
expectation that it would bring a 
revolution in performance. However, 
the first-generation Itanium core, code- 
named Merced, delivered disappointing 
performance results while consuming 
massive amounts of power and prevented 
the market-share breakthrough that 
Intel had hoped for. 

With the release of the Itanium 2 
core in late 2002, performance 
increased significantly, but the platform's 
reputation had been hurt by the 
low quality of the first-generation 
processors, and Itanium remains a 
high-end product with low market 
share. Intel still claims to be committed 
to the architecture. A new quad-core 
Itanium chip, code-named Tukwila, 
was released in February 2010, and 
according to Intel, at least two more 
generations are under development. 

HP is the last major manufacturer of 
Itanium-based workstations, and it still 
makes more Itanium servers than all 
other companies combined. HP’s work- 
stations, the ZX2000 and ZX6000, are 
easily available secondhand and have 
excellent Linux support. 

The only remaining commercial 
distribution with any focus on Itanium 
is SUSE Linux Enterprise Server. Red Hat 
offers a version of Red Hat Enterprise 
Linux for Itanium, but support for the 
platform will be ended in version 6. 


Red Hat Enterprise Linux 5 will be 
maintained and receive bug fixes until 
2014, so if you don’t mind missing out 
on feature updates, you can purchase 
a license from Red Hat. Red Hat also 
offers a free trial version, which 
blocks access to update repositories 
after 30 days. 

If you have a large Itanium system or 
cluster, SUSE Linux makes a lot of sense 
due to its active development status and 
excellent support for virtualization, but 
for smaller installations and hobbyists, 
several other systems are available, 
including Gentoo and Debian. Fedora 
and Ubuntu both define Itanium as a 
secondary platform and occasionally 
provide new releases or updates, but 
both largely have ignored the architec- 
ture in recent releases. The last build of 
Fedora available for Itanium was Fedora 
9, and Ubuntu releases for the platform 
have been broken or seriously buggy 
since 8.04. HP-UX, OpenVMS and 
Microsoft Windows also are available 
for Itanium. 

Debian probably is the most stable 
and modern IA64 Linux distribution 
available for free. It still is an officially 
supported Debian platform, and still is 
under active development. It offers all 
the features of x86 Debian, including a 
full GNOME desktop environment. 
Debian for Itanium has access to the 
full Debian package set and generally 
is fairly stable. In recent months, 
development has declined somewhat 
due to declining overall interest in the 
tanium platform, but it appears that 
A64 will continue to be a supported 
platform for the foreseeable future. 
An occasionally active mailing list 
exists for users and developers of the 
Itanium port of Debian. 

Red Hat and its derivatives occasionally 
have run on Itanium. Red Hat is preparing 
to release Red Hat Enterprise Linux 5.5, 
which will support the platform natively, 
but it might not be a good idea to 
run RHEL on a new Itanium system 
due to the fact that version 5 will be 
the last release available for |A64. 
CentOS, an open-source clone of 
RHEL, no longer supports Itanium, 
although the developers have sug- 
gested that future releases may run 
on it, as well as other less-common 
architectures including SPARC and 
Alpha. Fedora was available for 
Itanium through version 9, and some 


RPMs from version 10 are available. 
Overall, the Fedora experience on 
Itanium isn't bad with all updates 
installed, but users who want more 
up-to-date packages may end up 
needing to use source RPMs or 
compiling software themselves. 


Of the platforms discussed in this article, 
Power and especially Itanium both have 
a questionable future. Although IBM 
and Intel are committed to developing 
future generations of their products, 
the market for high-end proprietary 
processors has been somewhat eroded 
by increasingly fast and cheap x86 
processors. Many analysts felt that the 
Tukwila Itanium was underwhelming 

in comparison to both Power7 and 
high-end x86 server processors, such 

as recent Xeon and Opteron chips. IBM 
expects Power to be a viable platform 
for a long time, because it still is sub- 
stantially faster than the x86 alternatives, 
but even for them, competition is closer 
than it once was. As a result, Linux 
support for these platforms probably 
is going to decline over time, although 
as long as there is hardware using 
these architectures, people will be using 
and developing Linux on them, as has 
happened with “dead” architectures, 
such as the DEC Alpha and the HP 
PA-RISC. ARM, on the other hand, has 
a bright future, having been dominant 
on low-power systems for decades and 
starting to become popular on consumer 
computer hardware, with constantly 
improving Linux support. 


Kira Scarlett has been using Linux for eight years. She 
frequently ends up owning strange and unusual computer 
hardware, and she has used Linux on almost every major 
processor of the last 20 years. She also is interested in 
graphic design and is an avid hockey fan. Kira can be 
reached at kira_arc4@ovi.com. 


Resources 


Scratchbox: scratchbox.org 


Angstrom: 
angstrom-distribution.org 


Gelato: gelato.org 


Ubuntu PowerPC Wiki: 
wiki.ubuntu.com/PowerPC 
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“| think most distros are a lot more polished and user-friendly than they were a few years ago, but I’m going to go 
with Ubuntu. | used to use Kubuntu from 6.06 to 8.04, but the transition from KDE 3 to KDE 4 hasn't 


been the smoothest. | gave regular Ubuntu 9.10 a spin and have been really impressed, since 


it's probably the first GNOME-based distro I’ve actually enjoyed. There are practical rea- 
sons for going with Ubuntu as well. Canonical has done a great job getting it out 


there and making it known, as well as presenting it as an OS for every- 


day users and not just networks and servers. And, the fact that 
it’s such a popular distro means there are lots of users 
posting how-tos and solving common problems.” 
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“| wouldn’t say that ‘Ubuntu is the most easy Linux for 
everyone’. | definitely would agree that it is the one with the catchy-hard- 
to-forget name, in the HD-DVD vs. Blue-ray vein. When you put that aspect with the 


fact that it is free, then you get the ‘World’s Most Popular Linux Distro’, whether it’s the 


easiest one or not. Lots of people who don’t particularly care about ‘free’ don’t care about Ubuntu— 
especially the learning curve required to ‘fix it’. These people, willing to pay for quality software and 0S, 
are an admitted minority in the Linux camp, but they do exist. | don’t, however, think that these people give a fig 

about Linux ‘touching the masses’ and all the underlying tones of cloying that phrase implies. They just want an easy-to- 

use and efficient/intuitive OS that works without hassle. Ubuntu is the most popular Linux one, but not the easiest Linux one.” 


“Reasons | use Arch: 
Rolling upgrade. 


Up to date packages. 
. Awesome community/ , 


documentation. 
Great performance. 
Minimalist design. 


Simple from top to bottom. 


Teaches me as | go.” 


DEFAULT 
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ENVIRONMENT(S) 


(VERSION) 


LINUX KERNEL 


DEFAULT 
FILESYSTEM 


“| prefer Slackware because it’s very simple and stable. It 
gives me the power | need to get things done very efficiently.” 


“use CentOS simply because 
of its reliability. It’s also flexible, 
and very light—with it being light 
leaves more resources to actually 
do what you want. Hence, that’s 
why | use it for all my servers.” 


OFFICIAL PORTS 


“Ive been using Windows for a long time, since Windows 95, and I’ve been an IT profes- 
sional for about 9 years. Through it all, I've always been turned off to Linux. | didn’t have 
time to try anything new. | was just trying to keep up with the changes in Windows. 
Just a month ago, a new coworker gave me a Linux Mint co. | took it home and 
ran the live CD on one of my IBM laptops. I’ve been hooked ever since. | even changed 


my wife’s laptop from XP to Mint. The bottom line is, Linux just works....I’m sold.” 


DERIVATIVE 
DISTRIBUTIONS 


MOST 
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USED 

(READERS’ POLL) 


BEST FOR 
(READERS’ POLL) 


“I've had nothing 
but utterly awful 
experiences over 
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RH EL, despite 
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Linux, Moblin documentation 
None (user selected) 2.6.32 None Stable: x86, x86-64, Sabayon 4% Education, older hardware, is terrible too, 
(user selected) PA-RISC, PowerPC, real-time apps 5 
SPARC 64-bit, DEC Alpha; so I'd never run 
Development: MIPS, PS3, either by choice.” 
System Z/s390, ARM, SuperH 
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ext3 new users, older hardware Li nux 
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KDE (3.5.10) 2.6.16 None x86 None 4% Ease of installation, half-dozen of 
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JWM/ceWM 2.6.30.5 SquashFS None None 1% Ease of installation, GoBook P3 
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to kids as 
Blackbox, Fluxbox, FVWM, 2.6.29.6 ext4 x86, x86-64, IBM S/39 Slam64, SLAX, 4% Education, older hardware, gifts. At around 
KDE (4.2.14), WMaker, Xfce; VectorLinux security 
Community: GNOME $50 each (well 
- - ; used], this was 
KDE (4.1), GNOME (2.24) 2.6.27.19 ext3, JFS, XFSIA-32, x86-64, None 11% (with Getting support, proprietary - 
ReiserFS PowerPC, Itanium openSUSE) hardware support, security affordable. 
GNOME (2.28) 2.6.31; long-term ext4; x86, x86-64, Kubuntu (KDE), Edubuntu, 31% Ease of installation, getting 
support: 2.6.24 long-term ARM, SPARC Xubuntu (Xfce), Ubuntu (any flavor) support, new users 
support: ext3 Studio, Linux Mint, “Don't forget 
Crunchbang, Ubuntu 4 
Netbook Edition SliTaz 
Enlightenment, 2.6.29 ext3, JFS, XFSPower None 0% Gaming, older hardware, though. | have 
GNOME (2.16.0), ReiserFS proprietary hardware it on my old 
KDE (3.5.4) support 
433MHz 
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“| love live CDs, but liked PCLOS Big Daddy so much, | felt the need to install it with a dual-boot of 
Windows at the time. By the time PCLOS 2007 came out, I’d gotten a newer computer and erased 
the Windows partition to put the exclusive Linux desktop on it. | haven't looked back since. | no 
longer dual-booted. The other people | know who have PCLinuxOS tend not to be techie types 
that you see at work, but more like teenagers and housewives and early-adopter-gadgety folk 
around here—not the Computer Crowd, as much as the people with /ots of cool toys. They don’t 


“like GENtOO for its extremely useful control over 
the system and love the flexibility. It appeals to the 
tweaker in me! All my systems, including laptops, 


it is fantastic. 
If you need a 
lightweight 


run Gentoo! That’s five systems in total! | have tried 
Linux distro for 


other distros, but nothing comes close to Gentoo. 


| loved portage so much, at some point in time, | old hardware, | 


dual-boot either. When VirtualBox came to Synaptic repos years ago, | put my Windows XP install ported it to Solaris. Now, with prefix support, any- would take this 


body can use portage on Solaris, BSD or Mac OS. 
The Gentoo community is exemplary!” 


disk in there to test it out and made a video of Linux running Windows better than Windows. 
| ended up taking the virtual Windows off though, because | never used it. PCLinuxOS rules.” 


over Puppy 
Linux any day.” 
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INDEPTH 


An Introduction to MINIX 


It's not Linux, but MINIX can introduce you to the basic concepts without all the baggage. 


BRUCE BYFIELD 


Remember MINIX? Short for Minimal UNIX, MINIX is a close 
cousin of GNU/Linux. To GNU/Linux users, it is simultaneously 
familiar and foreign, and it challenges orthodox assumptions 
about how an operating system should be designed. 

MINIX originally was developed in 1987 by Andrew S. 
Tanenbaum as a teaching tool for his textbook Operating 
Systems Design and Implementation. Today, it is a text-oriented 
operating system with a kernel of less than 6,000 lines of 
code. MINIX’s largest claim to fame is as an example of a 
microkernel, in which each device driver runs as an isolated 
user-mode process—a structure that not only increases security 
but also reliability, because it means a bug in a driver cannot 
bring down the entire system. 

In its heyday during the early 1990s, MINIX was popular 
among hobbyists and developers because of its inexpensive 
proprietary license. However, by the time it was licensed under 
a BSD-style license in 2000, MINIX had been overshadowed by 
other free-licensed operating systems. 

Today, MINIX is best known as a footnote in GNU/Linux history. 
It inspired Linus Torvalds to develop Linux, and some of his 


MINIX remains a shell-based 
operating system, and its concessions 
to the desktop are minimal. 


early work was written on MINIX. Probably too, Torvalds’ early 
decision to support the MINIX filesystem is responsible for the 
Linux kernel’s support of almost every filesystem imaginable. 

Later, Torvalds and Tanenbaum had a frank e-mail debate 
about the relative merits of macrokernels and microkernels. 
This early history resurfaced in 2004 when Kenneth Brown of 
the Alexis de Tocqueville Institution prepared a book alleging 
that Torvalds borrowed code from MINIX—a charge that 
Tanenbaum, among others, so comprehensively debunked, 
and the book was never actually published (see Resources). 

Now at version 3.1.6, MINIX has taken a turn in its 
development. While versions 1 and 2 focused primarily on 
the operating system as a learning tool, with version 3, MINIX 
began targeting low-cost laptops and embedded devices as 
well. More generally, the project’s Web page recommends 
MINIX for “applications where very high reliability is required” 
and for projects where the GNU General Public License 
would be too restrictive. 

However, these new targets seem more ideal than real. 
| can find little evidence of MINIX being used in embedded 
devices or for its high reliability or licensing. Similarly, MINIX 
still lacks the user-friendliness that would make it a candidate 
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for a project like One Laptop Per Child. As with previous 
releases, MINIX’s greatest value continues to be as an educa- 
tional aid to give users experience of another UNIX-like system. 

Still, for those familiar with GNU/Linux, MINIX does take 
some acclimatization. Accordingly, what | present here is not 
a comprehensive review, but an introduction to help those 
who are interested in orienting themselves to MINIX, its 
structure and resources. 


Installing MINIX 

MINIX's hardware requirements (see Resources) should not be 
a major concern for most users. Requiring 16MB of RAM and 
a gigabyte of hard drive space, MINIX should install on most 
computers made in the last decade, even if all peripheral 
devices are not supported. 

If you are interested mainly in studying MINIX, you might 
consider installing it in a virtual machine. MINIX is installable 
with a variety of virtualization solutions, including Bosch, 
QEMU, VMware and VirtualBox. Instructions for each solution 
are available on the project Web site. Installing MINIX as a 
guest operating system has the advantage of allowing you 
to make easy comparisons with a GNU/Linux host. 

No matter how you decide to install MINIX, have some 
paper ready to take notes. Some on-line instructions are avail- 
able, but, at the time of this writing, they differ so significantly 
from those provided by the installer that they are not reliable. 
The first set of instructions (Figure 1) is especially important 
because it explains the following: 


@ That you install with the setup command. 

@ How to shut down the system. 

m@ That you use xdm to start the X Window System. 

™@ That you use packman to install additional packages. 


What the instructions do not mention is that you can log 
in after installation as the root user with no password. 


Figure 1. Bootup Instructions 


Although text-based, the MINIX installer should provide 
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CHECK OUT OUR BUYER'S GUIDE ON-LINE. 

Go to www.linuxjournal.com/buyersguide where you can learn 

more about our advertisers or link directly to their Web sites. 
few obstacles for anyone who has installed operating systems 
Thank you as always for supporting our advertisers by buying 


in the past. Probably the biggest standard challenge is to 
do expert partitioning, because MINIX has its own system. 
However, the default partition scheme, which includes 
separate partitions for /, /home and /usr, should be satisfactory 
for most users. 

A more serious problem for some people will be the fact 
that MINIX supports only eight common Ethernet cards; the 
installer does, however, auto-detect cards. 

True to its name, MINIX installs a minimal system. One of 
the installer’s final warnings is that the first time you start the 
new installation, you should add users and passwords. 

If you are installing on a multiboot system, you also need 
to add MINIX to the bootloader. For example, if you are using 
Legacy GRUB and MINIX is installed on the second partition of 
the first hard drive, the stanza in /boot/grub/menu.list would be: 


title MINIX 
rootnoverify (hd0,1) 
chainloader +1 


As with Windows, GRUB does not support MINIX natively 
and has to pass off its booting to MINIX’s own bootloader. 


Navigating MINIX 

MINIX remains a shell-based operating system, and its con- 
cessions to the desktop are minimal. It starts with a boot 
menu of different system states, including (assuming you 
followed the install instructions) a pristine version of the 
operating system that you can use for recovery. When you 
are finished, the command shutdown halts the system, and 
shutdown -r reboots it. 

For anyone who has used a UNIX-like system, the MINIX 
directory hierarchy should be broadly familiar (Figure 2). However, 
you will notice a few missing top-level directories, such as the 
ever-contentious /opt, and directories added to operating systems 
like GNU/Linux for user-friendliness, such as /cdrom and /media. 
Also missing is /proc, which tells you that the pseudo-filesystem 
procfs does not exist to access process information from the ker- 
nel. Because MINIX runs drivers in userspace, it does not have 
the need for /proc that GNU/Linux does. 


home lib mnt root sbin tmp 


Figure 2. File Hierarchy 


Descend a directory level, and you find that the logic of 
the directory hierarchy is differently applied. For instance, 
GNU/Linux’s /var/spool directory, which contains queues for 
cron jobs, printing and mail as well as locks, is located in 
/usr/spool instead. But, such examples are exceptions, and 
previous experience with UNIX-like systems can only benefit 
those exploring MINIX for the first time. 

What may require more acclimatization is MINIX’s naming 
system for devices. Open /etc/fstab, and, if you accepted the 
default partitioning scheme during installation, you will see 
something like: 
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/cQd0p0s1 


Although this naming system may seem intimidating at 
first, in practice, it is very simple. It lists the physical controller 
and disk, followed by the partition and sub-partition, with the 
first of each item numbered 0. 

Naturally, other distinguishing characteristics of MINIX will 
become clearer as you explore it in more detail. But if you do 
need help, MINIX supports man pages, just like most UNIX-like 
systems, and it includes an interesting application called 
whichman that attempts to find approximate matches to a 
query. However, you will not find any info pages, despite the 
fact that MINIX uses utilities provided by the GNU Project. You 
also can find help on the MINIX Wiki, although it is not always 
up to date and often suffers from a lack of detail. 


Software Selection and Installation 

When you install MINIX, the result is a minimal system (a setup 
that is in keeping with basic security principles). If you want 
more, you have to install it yourself. Beyond the basic system, 
MINIX has a small but well-rounded collection of 135 packages, 
tailored to the needs of the command line. By default, it uses 
the ash shell, but BASH and zsh are also available. It includes 
support for several programming languages, including Tcl, Perl, 
Python and FLTK, and users can choose between vile, vim and 
nano for text editors. 

Some of MINIX‘s applications, such as Kermit, might seem 
old-fashioned from a modern GNU/Linux user’s perspective. 
Others will seem thoroughly contemporary, such as SQLite, 
OpenSSL and wget. Then, there are the usual suspects, such as 
ImageMagick, tar and zip. You even can unwind with a game 
of Nethack on MINIX. In keeping with MINIX’s status as an 
educational operating system, typing a command without 
any parameters displays a brief summary of usage. 

In MINIX, you won't find desktop applications, such as 
Firefox or OpenOffice.org. Such programs are many times 


Figure 3. Equinox Desktop Environment (EDE) 
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Figure 6. Installing X with Packman 


larger than the whole of MINIX, and including them would 
go against the project's goals of being suitable for embedded 
systems. Strangely enough, you will find a package for The 
GIMP. But the closest you will find to Firefox is Lynx, and the 
closest to OpenOffice.org is Tex. 

For that matter, you will find little attention paid to graphical 
interfaces in general. The X Window System is available, but 
the interfaces are few. You can run TWM (Figure 4) for an 
extremely basic desktop, but with the unaliased text, you are 
better off at the command prompt. The Equinox Desktop 


Environment (Figure 3) is considerably more sophisticated, but 
unless you're doing something like viewing graphics, running 
any sort of graphical interface in MINIX is mostly beside the 
point. Although you could study the X Window System in 
MINIX, the overwhelming majority of the work you might do in 
MINIX works just as well from the command line, if not better. 

Whatever your choice of extras, they are installed with the 
command packman. Packman opens with a list of the available 
packages (Figure 5). Dependencies are not resolved automatically 
in packman, but the list informs you when a package requires 
another one. 

When you know what packages you want to install, press 
the q key, and enter their numbers at the prompt (Figure 6). 
When you are finished installing, press the q key twice to exit. 


Conclusion 

Assuming you have experience with UNIX-like operating systems, 
you shouldn’t need more than a session or two to familiarize 
yourself with MINIX and its resources. 

If your interest is not just casual, your next step might be to 
read the MINIX Developer's Guide. This concise guide goes all 
the way from the resources you might need to learn more about 
programming in MINIX to explaining the MINIX API and packaging 
format in detail. Then, you might want to see what MINIX 
projects are already organized on the project’s Who Is Working 
On What page and joining the Google Group for MINIX. 
Conversely, if you are considering using MINIX for teaching, 
look at the Teaching with MINIX Web page for resources. 

But is MINIX worth this effort? Is it, perhaps, a historical 
relic whose best days are past? How you answer that is very 
much a matter of perspective. 

On the one hand, MINIX development and teaching are both 
relatively small worlds, so individuals might expect (all else being 


equal) to contribute to them more easily and meaningfully than 
to larger free and open-source projects. MINIX development in 
particular seems to be at a significant stage as the project tries to 
redefine its relevance. And, there is something to be said about 
learning and teaching about UNIX-like systems in a smaller, less- 
cluttered environment, especially one that is not desktop-oriented. 

On the other hand, some might consider MINIX (to be 
frank) a dead end. Why, they might argue, should anyone put 
effort into such a small project when working with GNU/Linux 
or FreeBSD is more relevant today and promises to teach more 
marketable job skills? 


Assuming you have experience 
with UNIX-like operating systems, 
you shouldn't need more than a 
session or two to familiarize yourself 
with MINIX and its resources. 

Either way, MINIX is worth some attention. You may decide 
not to invest a lot of time in MINIX, but after examining it in 
any detail, you will probably return to your own free operating 
system of choice with a better understanding of how it is 


structured. For all the efforts to refocus MINIX, teaching 
is very much what it continues to do best.m 


Bruce Byfield is a computer journalist who covers free and open-source software. He has been 
a contributing editor at Maximum Linux and Linux.com, and he currently is doing a column 
and a blog for Linux Pro Magazine. His articles appear regularly on such sites as Datamation, 
LinuxJournal.com and Linux Planet. His article, “11 Tips for Moving to OpenOffice.org” was 
the cover story for the March 2004 issue of Linux Journal. 


Resources 


The Tanenbaum-Torvalds Debate: oreilly.com/catalog/opensources/book/appa.html 


Some Notes on the “Who wrote Linux” Kerfluffle, Release 1.5 (Kenneth Brown book proposal): www.cs.vu.nl/~ast/brown 


MINIX man pages: www.minix3.org/manpages 
MINIX Wiki: wiki.minix3.org/en/FrontPage 


MINIX Software Packages: www.minix3.org/software 


MINIX Hardware Requirements: wiki.minix3.org/en/UsersGuide/HardwareRequirements 


MINIX Developer's Guide: wiki.minix3.org/en/DevelopersGuide 


Who Is Working On What: wiki.minix3.org/en/WholsWorkingOnWhat 


Google Group for MINIX: groups.google.com/group/minix3 


Teaching with MINIX: minix1.woodhull.com/teaching 
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INDEPTH 


Automating Remote 


Backups 


Most home users don't think about backups till their disks crash. With a little bit 
of upfront work, you can automate your home backups and sleep easy at night. 


MICHAEL J. HAMMEL 


Linux users are a diverse group because of the wide swath of 
choices they have at their fingertips. But, whether they choose 
Ubuntu, Fedora or Debian, or KDE, GNOME or Xfce, they all 
have one thing in common: a lot of data. Losing data through 
hard disk failure or simply by overwriting is something all users 
must face at some point. Yet, these are not the only reasons to 
do backups. With a little planning, backups are not nearly as 
hard as they might seem. 

Hard disk prices have dropped to the point where USB 
storage easily replaces the need for off-line tape storage for the 
average user. Pushing your data nightly to external USBs, either 
local or remote, is a fairly inexpensive and simple process that 
should be part of every user's personal system administration. 

In this article, | describe a process for selecting files to back 
up, introduce the tools you'll need to perform your backups 
and provide simple scripts for customizing and automating the 
process. | have used these processes and scripts both at home 
and at work for a number of years. No special administrative 
skills are required, although knowledge of SSH will be useful. 


Why We Backup 

Before proceeding, you should ask yourself the purpose of the 
backup. There are two reasons to perform a backup. The first 
is to recover a recent copy of a file due to some catastrophic 
event. This type of recovery makes use of full backups, where 
only a single copy of each file is maintained in the backup 
archive. Each file that is copied to the archive replaces the 
previous version in the archive. 

This form of backup is especially useful if you partition 
your system with a root partition for the distribution of choice 
(Fedora, Ubuntu and so forth) and a user partition for user 
data (/home). With this configuration, distribution updates 
are done with re-installs instead of upgrades. Installing major 
distributions has become fairly easy and nearly unattended. 
Re-installing using a separate root partition allows you to wipe 
clean the old installation without touching user data. All that 
is required is to merge your administrative file backups—a 
process made easier with tools like meld (a visual diff tool). 

The second reason to perform a backup is to recover a pre- 
vious version of a file. This type of recovery requires the backup 
archive to maintain an initial full backup and subsequent 
incremental changes. Recovery of a particular version of a file 
requires knowing the time between when the full backup 
was performed and the date of the version of the file that is 
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desired in order to rebuild the file at that point. Figure 1 shows 
the full/incremental backup concepts graphically. 


| 
Incremental Backups 


Figure 1. Full backups replace archive contents. Incremental backups 
extend archives with time-based file changes. 


Incremental backups will use up disk space on the archive 
faster than full backups. Most home users will be more con- 
cerned with dealing with catastrophic failure than retrieving 
previous versions of a file. Because of this, home users will 
prefer full backups without incremental updates, so this article 
focuses on handling only full backups. Fortunately, adding support 
for incremental backups to the provided scripts is not difficult 
using advanced features of the tools described here. 

In either case, commercial environments often keep backups 
in three locations: locally and two remote sites separated by 
great distance. This practice avoids the possibility of complete 
loss of data should catastrophe be widespread. Home users 
might not go to such lengths, but keeping backups on separate 
systems, even within your home, is highly recommended. 


Tool Primer 
The primary tool for performing backups on Linux systems is rsync. 


This tool is designed specifically for handling copying of large 
numbers of files between two systems. It originally was designed 
as a replacement for rcp and scp, the latter being the file copy 
tool provided with OpenSSH for doing secure file transfers. 

As a replacement for scp, rsync is able to utilize the features 
provided by OpenSSH to provide secure file transfers. This 
means a properly installed SSH configuration can be utilized 
when using rsync. In fact, SSH transfers are used by default 
using standard URI formats for source or destination files 
(such as user@host:/path). Alternatively, rsync provides a 
standalone server that rsync clients can connect to for file 
transfers. To use the rsync server, use a double colon in the 
URI instead of a single colon. 

SSH (secure shell), is a client/server system for performing 
operations across a network using encrypted data. This means 
what you're transferring can’t be identified easily. SSH is used 
to log in securely to remote Linux systems, for example. It 
also can be used to open a secure channel, called a tunnel, 
through which remote desktop applications can be run and 
displayed on the local system. 

SSH configuration can be fairly complex, but fortunately, it 
doesn't have to be. For use with rsync, configure the local and 
remote machines for the local machine to log in to the remote 
machine without a password. To do this, on the local machine, 
change to $HOME/.ssh and generate a public key file: 


$ cd $HOME/.ssh 
$ ssh-keygen -t dsa 


ssh-keygen will prompt you for various information. For 
simplicity’s sake, press Enter to take the default for each 
prompt. For higher security, read the ssh-keygen and ssh man 
pages to learn what those prompts represent. 

ssh-keygen generates two files, id_dsa and id_dsa.pub. 
The latter file must be copied to the remote system 
under $HOME/.ssh and appended to the file 
$HOME/.ssh/authorized_keys. In this code, remoteHost 
is the name of the remote computer and /oca/Host is 
the name of the local computer: 


$ scp id_dsa.pub \ 
remoteHost:$HOME/.ssh/id_dsa.pub.localHost 

$ ssh remoteHost 

$ cd $HOME/.ssh 

$ cat id_dsa.pub.localHost >> authorized_keys 


In this article, | assume a proper SSH configuration with no 
password required in order to perform the rsync-based backups. 
These automated backup scripts are intended to be run from 
cron and require a proper SSH configuration. 


Backup UI: Grsync 

For users who prefer to use a desktop tool instead of scripts for 
setting up and performing backups, there is the Grsync tool. 

This is a GTK+-based tool that provides a nearly complete front 
end to rsync. It can be used to select a single source and desti- 

nation and is likely available from Linux distribution repositories. 


Grayne: test session 


Although previ- 
ous versions appear 
to have had an 
integrated cron 
configuration, the 
current version 
available with 
Fedora does not. 
Also, Grsync does 
not allow selection 
of multiple source 
files or directories 
nor does it allow 
setting exclusion Se 
lists. Both of these ie 
are supported by the 
rsync command line. 
Grsync can create a Bow 
session file that can 
be called from cron, 
but it does not 
include information 
on how to notify the 
user of the results 
of the backup. 

Due to the lack of cron integration, missing include and 
exclude options and no integration of user notification, 
Grsync is not an ideal backup solution. The scripts described 
here, along with the addition of ssmtp for simplified SMTP-based 
notification, are a better solution. 
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Figure 2. Grsync is a desktop tool for 
scheduling backups. Although generally 
useful, it lacks include/exclude options 
and direct cron management. 


File Selection 

With SSH set up and the choice to script backups instead 
of using a desktop application out of the way, it is time to 
consider what files to back up. Four sets of files should be 
considered: system configuration files, database files, users’ 
home directories and Web files. 

System configuration files include files such as the password 
and group files, hosts, exports and resolver files, MySQL and 
PHP configurations, SSH server configuration and so forth. 
Backup of various system configuration files is important even 
if it's not desirable to reuse them directly during a system re-install. 
The password and group files, for example, shouldn't be copied 
verbatim to /etc/passwd and /etc/group but rather used as 
reference to re-create user logins matched to their home 
directories and existing groups. The entire /etc directory can be 
backed up, although in practice, only a few of these files need 
to be re-installed or merged after a distribution re-installation. 

Some applications built from source, such as ssmtp, which 
will be used for notification in the backup scripts, may install 
to /usr/local or /opt. Those directories can be backed up too, 
or the applications can be rebuilt after a distribution upgrade. 

MySQL database files can be backed up verbatim, but it 
may be easier to dump the databases to a text file and then 
reload them after an upgrade. This method should allow 
for the database to handle version changes cleanly. 

User home directories typically contain all user data. 
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Generally, all files under /home except the /home/lost+found 
directory should be backed up. This assumes that all user 
logins are kept on /home. Check your distribution documentation 
to verify the location of user home directories. 

Home users may not use Web servers internally, but there is 
no reason they shouldn't be. Wikis, blogs, media archives and the 
like are easy to set up and offer a family a variety of easy-to-use 
communication systems within the home. Setting up document 
root directories (using Apache configuration files) under /home 
makes backing up these files identical to any other user files. 

There are also files and directories to avoid when per- 
forming backups. The lost+found directory always should 
be excluded, as should $HOME/.gvfs, which is created for 
GNOME users after they log in. 


Scripting and Notification 
All of the backups can be handled by a single script, but 
because backup needs change often, | find it easier to keep 
with UNIX tradition and created a set of four small scripts 
for managing different backup requirements. 

The first script is used to run the other scripts and send 
e-mail notifications of the reports on the backup process. 
This script is run by root via cron each night: 


#!/bin/bash 
HOST=*hostname* 
date="date’ 


mailfile="/tmp/$$.bulog" 


# Mail Header 


echo "To: userid@yourdomain.org" > $mailfile 
echo "From: userid@yourdomain.org" >> $mailfile 
echo "Subject: $HOST: Report for $date" >> $mailfile 
echo " " >> $mailfile 
echo "$HOST backup report:" >> $mailfile 
echo "------------------------------- >> $mailfile 


# Run the backup. 
$1 >> $mailfile 2>&1 


# Send the report. 

cat $mailfile | \ 
/usr/local/ssmtp/sbin/ssmtp -t \ 
-auuserid@yourdomain.org -apyourpassword \ 
-amCRAM-MD5 

rm $mailfile 


The first argument to the script is the backup script to run. 
An enhanced version would verify the command-line option 
before attempting to run it. 

This script uses an external program (ssmtp) for sending 
backup reports. If you have an alternative tool for sending 
e-mail from the command line, you can replace ssmtp usage 
with that tool. Alternatively, you can skip using this front 
end completely and run the backup scripts directly from 
cron and/or the command line. 


70 | june 2010 www.linuxjournal.com 


ssmtp 
ssmtp is a replacement for Sendmail that is considerably less 
complex to configure and use. It is not intended to retrieve 
mail, however. It is intended only for outbound e-mail. It has 
a small and simple configuration file, and when used as a 
replacement for Sendmail, it will be used by command-line 
programs like mail for sending e-mail. 

ssmtp is not typically provided by Linux distributions, but 
the source can be found with a Google search on the Internet. 
Follow the package directions to build and install under /usr/local. 
Then, replace sendmail with ssmtp by setting a symbolic link 
from /usr/sbin/sendmail to the installation location of ssmtp. 


$ mv /usr/sbin/sendmail /usr/sbin/sendmail.orig 
$ In -s /usr/local/sbin/ssmtp /usr/sbin/sendmail 


lf your distribution supports the alternatives tool, you may 
prefer to use it instead of the symbolic link to let the system 
use ssmtp instead of Sendmail. Note that, as a bonus, when 
the author replaced Sendmail with ssmtp, LogWatch suddenly 
began sending nightly reports via e-mail, allowing me a view 
on system activity | never had seen before and which many 
Linux users probably never have seen before either. 


System Configuration File Backups 

Backing up system configuration files is handled by a Perl 
script that verbosely lists the files to be copied to a location 
on the /home partition. The script is run by root via cron 
every night to copy the configuration files to a directory in 
user data space (under /home): 


#!/usr/bin/perl 


$filelist = <<EOF; 
/etc/passwd 
/etc/group 
# other config files to backup 
EOF 
@configfiles = split('\n', $filelist); 
for (@configfiles) 
{ 
if (-e $_) { $files = join(" ", $files, $_); } 
elsif (index($_, "*") >= 0) { 
$files = join(" ", $files, $_); 


} 
print, “Creating, archive......\n"; 
“tar Pczf $ARGV[0]/systemfiles.tar.gz $files’; 


This brute-force method contains a list of the files to back up, 
joins them into a single tar command and builds a tar archive of 
those files on the local system. The script is maintained easily by 
modifying the list of files and directories. Because the configura- 
tion files are copied locally to user data space, and user data 
space is backed up separately, there is no need for rsync com- 
mands here. Instead, the system configuration tar archive is kept 
with user data and easily referenced when doing restores or 


system upgrades. The backup script functions as a full backup, 
replacing the tar archive with each execution unless a different 
destination is specified as a command-line argument. 

What this script lacks in Perl excellence it makes up for in 
simplicity of maintenance. Note that the “retail” version of 
this script ought to include additional error checking for the 
command-line argument required to specify the location to 
save the archive file. 


Database Backups 
Like system configuration files, databases are backed up to user 
data directories to be included in the user data backups. Databases 
are of slightly higher importance in day-to-day use, so this script 
uses a seven-day rotating cycle for database file dumps. This 
allows restoring backups from up to a week ago without overuse 
of disk space for the backups. This method is not incremental, 
however. It is a set of seven full backups of each database. 
Like the system configuration file backup script, this script 
lists the items to back up. The mysqldump command assumes 
no password for the root user to access the databases. This is 
highly insecure, but for users behind a firewall, it is likely the 
easiest way to handle database management: 


#!/usr/bin/perl -w 

use File::Path qw(make_path remove tree); 

my $BUDIR1="/home/httpd/db" ; 

my ($sec,$min,$hour,$mday,$mon, $year, 
$wday,$yday,$isdst) = localtime time; 

$year += 1900; 

$mon += 1; 

if ($mon < 10) { $mon = "O".$mon; } 

if ($mday < 10 ) { $mday = "O".$mday; } 

$TODAY = $wday; 


@dbname = ( 
"mysql", 
"wordpress", 


make_path ("$BUDIR1/$year") ; 
foreach $db (@dbname) { 
$cmd = "mysqldump -B -u root $db " . 
"-r $BUDIR1/$year/$TODAY-$db. sql"; 
system("$cmd") ; 


print ("Database Backups for 
$year . "/"\. $mon . "/" , 
$mday . "\n"); 
Pint (aasseSoscesessessssasesseaseeS Aa") 53 
open(PD, "ls -1 $BUDIR1/$year/$TODAY-*.sql |" ); 
@lines = <PD>; 
close(PD) ; 
$output = join("\n", @lines); 
print ($output) ; 


Unlike the configuration file backup script, this script prints 


out the list of files that have been created. This provides a 
quick, visual feedback in the e-mailed report that the backups 
produced something meaningful. 


User Data Backups 

The system configuration backup script and the database 
backup script are run first to generate backups to user data 
space. Once complete, all data is ready to be backed up to the 
remote system with an rsync-based script: 


#!/bin/bash 
function checkRC 


{ 
rc=$1 
name=$2 
if [ $rc != 0 ] 
then 
echo "== $name failed with rsync rc=$rc ==" 
fi 


} 
LOGIN=root@feynman 
BRAHE=$LOGIN: /media/BackupDrive/feynman 


if ¢ "$1" J="" ] 
then 

BRAHE=$1 
fi 


The script includes a shell function to test rsync’s return 
code and print an error message on failure. The front-end 
script redirects output from this script to a file, so error 
messages show up in the e-mailed backup report. 

The default destination for the backup is configured at 
the start of the script. The first command-line argument 
can be used to override the default: 


DIR1="/home/httpd" 
DIR2="/home/mjhammel" 
EXCL2=--exclude-from=/home/mjhammel/.rsync/local 


The user data backup script is focused on directories. 
Unlike the other backup scripts, the list of items to back up are 
hard-coded in separate variables. Again, this is a brute-force 
method used for simplicity, because each directory to back up 
may have one or more sets of include and exclude arguments. 
Associative arrays could be used instead of the set of variables 
in a more generalized version of this script. 

Notice that this configuration calls out individual directories 
under /home instead of backing up all of /home. The script 
from which this was pulled is used on a machine with 
development directories under /home that do not need 
to be backed up. Specifying /home and using an exclusion 
file is an alternative way of doing the same thing: 


DATE=‘date° 

echo "== Backing up “uname -n* to $BRAHE." 
echo "== Started @ $DATE " 

echo "== Directory: $DIR1" 
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errs 


rsync -aq --safe-links $DIR1 $BRAHE 
checkRC $? "$DIR1" 


The first directory is backed up to the remote system. The 
-a option tells rsync to operate in archive mode, where rsync 
will do the following: 


m Recursively traverse the specified directory tree. 

™ Copy symlinks as symlinks and not the files they point to. 

™ Preserve owner, groups, permissions and modification times. 
™ Preserve special files, such as device files. 


The safe-links option tells rsync to ignore symbolic links 
that point to files outside the current directory tree. This way, 
restoration from the archive won't include symbolic links that 
may point to locations that no longer exist. The -q option tells 
rsync to run with as few non-error messages as possible: 


echo "== Directory: $DIR2" 

rsync -aq --safe-links $EXCL2 $DIR2 $BRAHE 
checkRC $? "$DIR2" 

DATE= date 

echo "Backups complete @ $DATE" 


The second directory tree is backed up using an exclusion 
list. This list is a file that specifies the files and directories 
within the current directory tree to be ignored by rsync. Entries 
in this file prefixed with a dash are excluded from the set of 
files and directories rsync will process. The three asterisks 
match anything below the specified directories: 


- /mjhammel/.gvfs/*** 
- /mjhammel/Videos/*** 
- /mjhammel/brahe/*** 
- /mjhammel/iso/*** 


This example shows that no files under the Videos and iso 
directories will be included in the backup. It would be a poor 
use of disk space to back up files that exist in your home 
directory but that also can be retrieved from the Internet. 

The brahe reference is a mountpoint for the home directory 
of an identical user ID on a remote system. This allows access to 
files under a login on another system simply by changing into 
the remote system's local mountpoint. But, there is no reason 
to back up those remote files on the local system, as that 
remote system has its own backup scripts configured. 

The full version of this script includes an SSH-based verifi- 
cation that the remote system has the required external USB 
drive mounted and it is available for use. This allows the script 
to recognize that the remote system is misbehaving before 
wasting time trying to run a backup that would fail anyway. 


Automation via Cron 
The order in which these scripts is run is important. The system 
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configuration file backup script and the database backup script 
can run in parallel but must complete before the user data 
backup script is run: 


30 @ * * * /path/to/backup-db. pl 

30 1 * * * /path/to/backup-configfiles.sh \ 
/path/to/save/dir 2>&1 > /dev/null 

30 2 * * * /path/to/backup-frontend.sh \ 
/path/to/backup-data.sh 


To pass arguments to backup-data.sh, enclose the entire 
command in double quotes: 


30 2 * * * /path/to/backup-frontend.sh \ 
"/path/to/backup-data.sh 
root@copernicus:/backups" 


Each morning, the backup report is available for each 
machine that runs these scripts and can be reviewed to make 
sure the backups completed successfully. In practice, the most 
common problems encountered are related to unmounted 
or non-functioning drives, or to network outages that occur 
before or during the backup process. 


Summary 

In preparing a personal backup strategy, it is important to 
identify the purpose of the backup, establish a set of processes 
that prepares files for backup and performs backups to remote 
systems. It is also important that automation of these processes 
provide feedback, so users can have at least a starting point 
of understanding why backups are failing and when that 
may have occurred. 

The methods shown here are somewhat simple and certainly 
not ideal for every user. The scripts probably are not bug-free 
and also have room for improvement. They are intended only as 
a starting point for building personal backup plans. | welcome 
feedback on any improvements you make to these scripts.m 


Michael J. Hammel is a Principal Software Engineer for Colorado Engineering, Inc. (CEI), in 
Colorado Springs, Colorado, with more than 20 years of software development and management 
experience. He has written more than 100 articles for numerous on-line and print magazines and 
is the author of three books on The GIMP. the premier open-source graphics editing package. 


Resources 


Backup Scripts for This Article: ftp.linuxjournal.com/ 
pub/lj/listings/issue194/10679.tgz 


ssmtp: www.graphics-muse.org/source/ 
ssmtp_2.61.orig.tar.gz 


rsync: samba.anu.edu.au/rsync 
OpenSSH: www.openssh.com 


meld: meld.sourceforge.net 


TECH TIPS 


> Formatting Information about RPMs 

RPM packages contain a number of potentially useful information 
fields, and you can see many of them by using the -q and -i 
options with a package name: 


$ rpm -q -i kernel-desktop 


Name : kernel-desktop Relocations: (not relocatable) 
Version : 25.31.20 Vendor: openSUSE 

Release 2 ORL. Build Date: Thu 28 Jan 2010 ... 
Install Date: Sat 20 Feb 2010 ... Build Host: build35 

Group : System/Kernel Source RPM: kernel-desktop-... 
Size : 122840714 License: GPLv2 

Signature : RSA/8, Thu 28 Jan 2010 09:16:41 AM MST, ... 

Packager : http://bugs.opensuse.org 

URL : http://www.kernel.org/ 

Summary : Kernel optimized for the desktop 

Description 


This kernel is optimized for the desktop. ... 


Source Timestamp: 2010-01-27 08:20:11 +0100 

GIT Revision: bb438b6d99aaffb7aade40764bab1810cc21b01b 
GIT Branch: openSUSE-11.2 

Distribution: openSUSE 11.2 


These fields and others can be output individually by using 
the --qf or --queryformat options for rpm. Not everything 
above is directly an option, but many are, such as NAME and 
VERSION, so that you can do something like: 


$ rpm -q --qf "Installed kernel is v%{VERSION}\n" kernel-desktop 
Installed kernel is v2.6.31.12 


The format string is similar to a printf format string, except 
the type specifier is replaced by the tag to output inside 
braces. To see a table of all installed packages and their 
versions, you could do this: 


$ rpm -q -a --qf '%-30{NAME} 
gpg-pubkey 
yast2-trans-stats 


Version %{VERSION}\n' |head 
Version a1912208 
Version 2.15.0 


yast2-country-data Version 2.18.20 
libpciaccess0 Version 7.4 
Libpth20 Version 2.0.7 
libpcred Version 7.9.0 
netcat Version 1.10 
libusb-1_0-0 Version 1.0.2 
libbz2-1 Version 1.0.5 
Libgmp3 Version 4.3.1 


You also can change the formatting for an item by append- 
ing a qualifier. For example, in the info listing above, there’s a 
field called Install Date. The actual rpm tag is INSTALLTIME, 
and if you use that directly you get a less-than-useful value: 


$ rpm -q --qf "Kernel installed %{INSTALLTIME}\n" kernel-desktop 
Kernel installed 1266703208 


For something more useful, append : date to the tag: 


$ rpm -q --qf "Kernel installed %{INSTALLTIME:date}\n" kernel-desktop 
Kernel installed Sat 20 Feb 2010 03:00:08 PM MST 


—MANTRA UNIX 


> Connect to Your Google Calendar from 
the Command Line with gcalcli 
gcalcli is an easy-to-use command-line tool to interact with 
your Google Calendar. gcalcli probably is not installed by 
default on your system, but it may be available via your 
package manager. If it's not available, get the source at 
code.google.com/p/gcalcli. 

Once installed, you can view your current calendar week 


by typing: 
$ gcalcli --user USERNAME --pw PASSWORD calw 


To view the current month of calendar, the command is 
very similar: 


$ gcalcli --user USERNAME --pw PASSWORD calm 


Adding an item to your calendar is easy as well with the 
quick option: 


$ gcalcli --user USERNAME --pw PASSWORD quick \ 
‘Write another Tech Tip for LJ tomorrow 5pm' 


gcalcli has many other options, such as choosing your 
own color scheme and agenda view. See the man page for 
more options. 
—KRISTOFER OCCHIPINTI (AKA METALX1000) 


> Get Rid of the Annoying “x is an 
executable text file” Message Box 

When using GNOME, if you open a text file that has the 
execute bit set, you get an annoying message box each time 
saying “Do you want to run x.txt or display its content? 
x.txt is an executable text file.” 

To get rid of this annoying message box, in Nautilus, go 
to Edit—Preferences—Behaviour, and check the radio button 
next to view executable text files when they are opened. The 
next time, the file will open directly, and no such message 
box will irk you. 

—MANOJ GUMBER 


Send a tech tip to techtips@linuxjournal.com, and if we 


publish it in the magazine, we'll send you a free T-shirt. 
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POINT/COUNTERPOINT 


KYLE RANKIN 


BILL CHILDERS 


Mobile Phones 


Kyle and Bill have argued about everything from cloud computing to 
AJAX. This month, join the guys as they argue about something much 
more personal: mobile phone preferences. Where do you stand? 


BILL: So Kyle, | hear you've got a shiny new 
wireless phone. What'd you get? 


KYLE: Well, after reviewing a Nokia N900 for a 
few months, when it was time to give it back, | decided 
to buy one of my own [see Kyle's review of the Nokia 
N900 in the May 2010 issue of LJ]. 


BILL: Wow, you picked that over a BlackBerry, 
Droid or iPhone? 


KYLE: Yeah. Honestly, | was looking for more of 
a portable Linux computer and less of a smartphone. 
Because | wanted Linux, the iPhone and Blackberry 
were out of the equation, so that left me with a choice 
between the Droid and the N900. How many phones 
are you carrying around these days? 


BILL: Just two—one personal and one work- 
assigned. | try to keep a good work/home separation 
these days. You're running two phones as well, from 
what | remember. 


KYLE: Between the Droid and the N900, the hard- 
ware was mostly the same (same processor, hardware 
keyboard and so on), so it came down to the OS. In my 
opinion, Maemo was just more open and hackable out 
of the box than Android. Plus, all the apps for Android 
are written in a custom version of Java. Also, on 
Android, if you really want to own the device, you have 
to run unauthorized firmware that relies on exploits just 
to get root. On Maemo, root is easy to get out of the 
box without voiding any warranties or getting any C&D 
letters in the mail. 


BILL: Yeah, well, those pesky cellular carriers don’t like 
modified devices mucking about on their networks. 

In my experience, Android isn’t quite like the Linux 
we use on our laptops. Android is far more integrated 
and streamlined. For instance, there’s no X server. And 
thanks to your—l'll use the word “distaste” —of all 
things Java, you decided to go with the Maemo- 
powered N900. How do you like it so far? 


KYLE: | have to admit, I've been pretty pleased 
with it so far. | think Maemo is about as close to a regu- 
lar Linux distribution that you'll get on a portable device 
that still has lots of the features of some of the shinier 
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smartphones. Speaking of shiny, last | heard you were 
still on the iPhone bandwagon. 


BILL: Oooh, shiny... 


KYLE: So, why no Android or Maemo device in 
your pocket? 


BILL: Practicality. | got my iPhone 3GS last year, 
and the only Android device then was the T-Mobile G1, 
which is on the wrong network, and there was no 
Maemo device at the time. Like all things Apple, 
the experience hasn't been all that bad. 

It's like driving a BMW. You can’t open the hood 
and change the oil because only the dealer can do 
that, but you can cruise down the road at 80 MPH, 
snubbing your nose at the folks who don’t have the 
nice ride and air conditioning you have. 


KYLE: Thanks for the car analogy, by the way, you 
know how | love those. Since you did bring up the car 
analogy though, | thought we Linux users didn't want 
our hoods welded shut? Since you got it, there have 
been a few different devices to come out with similar 
hardware but with either Android or Maemo, so why 
not switch? 


BILL: Well, for one, I’m not made of money. $300 
for the iPhone last year, and then another $500 for 
an unlocked Maemo device is just a little too much 
for my CFO at home to handle. And, you're welcome 
on the analogy. | know how much you love those. 
Although the hood may be welded shut, you can 
pop the hood if you know how (via jailbreak). And 
yes, my phone is jailbroken. 


KYLE: See, that’s the deal-breaker for me both 
on the iPhone and on Android devices. | don’t think 
| should have to jailbreak anything to run what | want 
on it. If you truly own the device, you should be able 
to install your own software. 


BILL: Another reason why I've stuck with the 
iPhone to date is that we have a stable of iDevices 
around here. | swear, the things have procreated 
overnight. Kelly's also running an iPhone, my daughter's 
got an iPod Touch, and my son has a jailbroken first- 
generation iPhone without a SIM. All apps we buy can 


land on all the devices because they are associated with the same 
iTunes account. | know, the next thing you're going to bring up is 
“walled garden”! Although | get the whole freedom argument, 
sometimes it’s nice to have things that “just work”. 


KYLE: And, every app is now tied to those devices, so even 
if you did want to switch to a different OS, you'd have to face 
throwing that money you spent away. 


BILL: That's true, but things just work. That happens with any 
installed base of commercial software, by the way. 


KYLE: | mean, it’s a nice way to make sure you stick with a 
particular vendor, but again, it seems to fly in the face of what we 
stand for as longtime Linux users. It sounds like if it just worked, 
you wouldn't have to jailbreak your device, now would you? 


BILL: Hey, you're making a moral argument out of this. This is 
a practical thing. After a day of hacking on servers and toiling in 
the data center, the last thing | want to do is mess around on my 
daughter's handheld device. 


KYLE: Every geek | see with an iPhone seems to have a 
jailbroken one, so basically to get to this magical “just works” state, 
people have to take their expensive portable computer out of 
warranty. Anyway, nothing says | have to hack my N900. You certainly 
can get plenty of use out of everything it offers by default. It just 
has a whole other world of options open to you if you do want to 
tinker, just like any other regular Linux install. 


BILL: To bring up another car analogy, my dad has been a 
mechanic forever. Yet my mom's car, and his truck, are relatively 
new and covered by warranty. Why? Because although he can 
build a kick-butt vehicle out of junk, he simply doesn’t want to. 
He can just hand the keys to someone and say “fix it”. He has 
the option to open the hood, just like | do with my jailbreak, 
but he doesn’t have to. 


KYLE: Not another car analogy. 
BILL: Yes, another car analogy—cause you know I'm all about that. 


KYLE: You don’t have to open the hood with the N900 either. 
There's a whole set of default applications, plus many more are 
available with the standard application manager. 


BILL: | have an N800 Maemo device, and | had to tinker a 
lot with it to get it where | wanted. 

Do you get root right out of the box? | don’t think you do. 
You have to install gainroot, | believe. 


KYLE: All you have to do is install one extra program called 
rootsh, and root is yours, and honestly, | think that is just so you 
can say you accept the responsibilities of root. See, with your 
N800, | think you tinkered with it because you knew you could 
tweak it. With an iPhone, basically it either does something you 
want or you are out of luck. 
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___ POINT/COUNTERPOINT 


BILL: Yeah, | wanted to tweak with the N800 
more, I'll grant you that. | even wrote an article on 
it. Although the N800 and N900 share an ancestry, 
the use case is different. One's a tablet PC compan- 
ion, the other is a phone. But jailbreaking isn’t 
much harder than installing your rootsh program. 
ran one executable on the computer, and it was 
done. Regarding the iPhone, I’ve gotten it to do 
the tasks I’ve needed. I've clearly not been out of 
uck with it. 


KYLE: Yet | bet you didn’t get that jailbreaking 
app from the app store did you? 


BILL: No, of course not. It was merely a google away. 


KYLE: It's like saying, “Sure, | can get any cable 
channel | want now that | got this descrambler.” 


BILL: Well, yeah, so what? | can get any cable 
channel | want. But that’s not the point of this column, 
is it? We're not here to discuss the morality of a device, 
but its practicality. 


KYLE: Really the argument between the iPhone 
and environments like Maemo is no different from 
the argument about OS X versus Linux. 


BILL: |'ll agree there. Actually, they are precisely 
the same, as iPhoneOS uses the OS X kernel, and 
Maemo uses Linux. That's the first analogy you've used 
in this article that has legs. 


KYLE: It comes down to whether you are willing 
to sacrifice the freedoms you are used to in Linux to 
have something that allegedly “just works”, or if it 
doesn’t, you can buy apps until it does. 


BILL: I'll bet you I've spent less on my iPhone 
+ apps than you did on your N900. 


KYLE: Possibly. After all, | bought the N900 shortly 
after it came out at an unsubsidized and unlocked 
price. Just like on OS X, you can generally buy your 
way out of your problems. 


BILL: Sometimes, that's the most efficient use of 
resources. My time is worth something. 


KYLE: But then, you seem to be fine with any and 
all locks, so I'm sure you are fine being locked into 


a phone contract as well. 


BILL: | don't like most locks. | typically break them. 
| don’t mind a phone contract though. 


KYLE: See, my time is worth something, but so is 
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my freedom. The beauty of open-source software is 
that most of the time, I’m not the only one who wants 
a feature. Because the platform is open, most of the 
time someone else adds a cool program or feature for 
me. Even if others don’t, at least | have the option if 

| want it. Plus, on the N900, | can code in C, C++, 
Python or even bash and use either GTK or Qt if | 
want, and | don’t have to get Apple's blessing for 
others to use and help improve my program. 


BILL: You're trying to pitch me on running Linux, 
man. | am on the editorial staff here. | get it. | choose, 
today, for my wireless device not to run Linux. I'll 
admit, that irks me a bit. But it's not enough to cause 
me to dump the installed base and change my work 
paradigm...again. 


KYLE: |’m just saying the same principles apply 
whether your computer is desktop-sized or fits in 
your pocket. In fact, as more and more people use 
pocket-sized computers, these issues are going to 
become more important, not less. 


BILL: Remember, | moved to the iPhone last year. 
| really don’t feel up to changing things drastically 
again. It's about practicality for me. 


KYLE: The bottom line for me is that | want my 
portable computer to give me the same freedoms I’m 
used to on my desktop or laptop. Right now, for me, the 
only platform that seems to get close is Maemo. | think 
the open-source model works, and | want it enjoy those 
advantages no matter what device | use. 


BILL: That's cool, and that’s your priority. Mine is 
to have the device's tech just get the heck out of my 
way so | can do what | need to do. At the end of the 
day, I'm tired, and | want to get stuff done so | can 
get home to my kids. 

| won't lie and say I've not thought about getting 
an N900. | have. They look way cool, but playing with 
a device isn’t my top priority right now. 


KYLE: Like always, | think we'll have to agree to 
disagree on this one. 


BILL: You think we'll have to? | know we will. 
But that’s okay, we've done that before too.™ 


Kyle Rankin is a Systems Architect in the San Francisco Bay Area and the author of 
a number of books, including The Official Ubuntu Server Book, Knoppix Hacks and 
Ubuntu Hacks. He is currently the president of the North Bay Linux Users’ Group. 


Bill Childers is an IT Manager in Silicon Valley, where he lives with his wife and 
two children. He enjoys Linux far too much, and he probably should get more sun 
from time to time. In his spare time, he does work with the Gilroy Garlic Festival, 
but he does not smell like garlic. 
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Commons Interests 


Were the Winter Olympics a win for Creative Commons? boc SEARLS 


On a cold February morning in 2009, 
| noticed beautiful ice patterns had 
formed overnight inside our apartment's 
storm windows. Some looked like 
corners of snowflakes. Some looked 
like trees. Others looked like feathers. 
Naturally, | shot pictures of them. Later 
| put the photo set up on Flickr, tagged 
the images generously and gave them 
all a Creative Commons license meant 
to encourage their enjoyment and 
re-use. That license happened to be 
Attribution-Share Alike 2.0 Generic. 
The decision to use that license was 
not a highly considered one. It’s a default 
| chose back when | started uploading 
photos in 2005. On the whole, this has 
worked very well. For example, as of 
today, | have more than 34,000 photos 
on Flickr, more than 130 of which appear 


in Wikimedia Commons, and most of 
those also show up in Wikipedia. If you 
go to the Wikipedia pages for Boreray 
Island, San Gorgonio Mountain, Sarah 
Lacy or dozens of other topics, you'll find 
them illustrated by photos of mine, 
through no additional effort of my own. 

| see this as nature taking its course. | 
am as generous with my photos as trees 
are with leaves in autumn, and | wish 
to exercise the same level of control 
over how they are used. | create them 
for the commons. Alas, while Creative 
Commons does offer public domain 
tools (http://creativecommons.org/ 
publicdomain), Flickr doesn’t leverage 
those. So instead | go with one that | 
hope will encourage re-use going for- 
ward, as well as credit back to myself— 
and to other creators, if any are involved. 


Not that | mind making money. Over 
the years since | started posting on Flickr, 
about $400 has flowed my way, all in the 
form of voluntary payments for one use 
or another. Still, that’s not my purpose in 
putting the pictures up there. My pur- 
pose is making them useful. To anybody. 

In November 2009 one of those 
anybodies turned out to be Mark Levy, 
VP and Creative Director for NBC Sports, 
writing to say the network would like 
to use some of my winter ice images in 
graphic backgrounds for the upcoming 
Winter Olympics in Vancouver. Since text 
already would be running over those 
backgrounds, he asked permission to 
waive the license details and handle attri- 
bution by listing me in the credits as a 
member of NBC's design team. | said that 
was fine and didn’t give it more thought 
until the 
Olympics 
started 
running. 
To my sur- 
prise, my 
ice photos 
served as 
framing 
elements 
for all kinds 
of stuff: 
talking heads in studios, features about 
athletes, titles of events and settings, and 
text running below the action on ski 
slopes and toboggan runs. It was not 
only fun to watch, but also to feel a 
sense of participation in a good cause 
that transcended the commercial 
interests involved. In other words, 
| felt honored, not exploited. 

Some concern was raised, however, 
close to home—at Harvard's Berkman 
Center, where | have been a fellow 
for the last several years. Creative 
Commons was born at Berkman, when 
Lawrence Lessig was there around the 
turn of the millennium. One of the 
other fellows at Berkman, Herkko 
Hietanen (who wrote his doctoral thesis 
on Creative Commons) saw a potentially 
interesting problem with NBC's use of 
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the photos. In his blog at MIT's 
Communications Futures Program, 
Herkko wrote, “...there is a legal side 

to the story that could have wreaked 
havoc. What NBC's designers may have 
missed was that the license Doc Searls 
used did not only require credit but also 
that the adaptations made from Searls’ 
photos share the same license terms.” 
Later he added, “The exact amount of 
the material that would be affected with 
the ShareAlike term is unclear....To make 
the matter even more complicated, NBC 
does not own and can’t license out 
many of the copyrightable elements that 
are shown on the screen next to the 
background graphics. There is no doubt 
that NBC never wanted its crown jewels, 
the Olympics, to fall to any royalty-free 
licensing scheme.” Herkko also noted 
that NBC and | were both satisfied with 
our agreement and added this response 
from Creative Commons VP Mike 
Linksvayer: “NBC's extensive use of 
Searls’ photos, and Searls’ happiness for 
that use, demonstrates the power of 
Creative Commons licenses as a means 
to signal openness to collaboration, 
even if the resulting collaboration does 
not occur under the terms of the license 
originally offered.” 

But that didn’t sit well with everybody 
either. On my blog, one commenter 
wrote, “Wow. Nice of you to give a 
corporation something worth a few 
thousand dollars for free, without even 
having them abide by the share-alike 
clause of copyleft!” 

| still don’t know what | should 
have done differently here. | believe in 
cultivating a culture of sharing, mixing and 
remixing. | also want to help Creative 
Commons push forward its pioneering 
work in copyright and reform. To be safe 
for now, I’m moving my photos on Flickr 
to a simple attribution license. But I’m 
also open to suggestions—for all of us.m 


Doc Searls is Senior Editor of Linux Journal. He is also a 
fellow with the Berkman Center for Internet and Society at 
Harvard University and the Center for Information Technology 
and Society at UC Santa Barbara. 
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+ 3x 3.5”SAS/SATA Hot-swappable Drive Bays 

Intel® 5520 Chipset with QuickPath Interconnect (QPI) 

+ Up to 192GB DDR3 1333/1066/800 SDRAM ECC Registered 

Memory 

1 (x16) PCI-E (Low Profile) 

+ Matrox G200eW 8 MB DDR2 Memory Video 

Integrated Remote Management - IPMI 2.0 + IP-KVM with 

dedicated LAN 

+ All four nodes share a Redundant 1200W High-efficiency Power 
Supply (Gold Level 92%+ power efficiency) 


800-820-BSDi | Powerful. 
http://www.iXsystems.com Intelligent 


Enterprise Servers for Open Source 


Intel, the Intel logo, and Xeon Inside are trademarks or registered 


trademarks of Intel Corporation in the U.S. and other countries. 


More TFLOPS, 
Fewer WATTS 


Microway delivers the fastest and greenest floating 
point throughput in history 


Enhanced GPU Computing with Tesla Fermi 


» 480 Core NVIDIA® Tesla™ Fermi GPUs deliver 1.2 TFLOP . 
single precision & 600 GFLOP double precision performance! 


» New Tesla C2050 adds 3GB ECC protected memory 

» New Tesla C2070 adds 6GB ECC protected memory 

» Tesla Pre-Configured Clusters with $2070 4 GPU servers 
» WhisperStation - PSC with up to 4 Fermi GPUs 

» OctoPuter™ with up to 8 Fermi GPUs and 144GB memory 


New Processors 
» 12 Core AMD Opterons with quad channel DDR3 memory 
» 8 Core Intel Xeons with quad channel DDR3 memory 


> om oon on we 


» Superior bandwidth with faster, wider CPU memory busses 


» Increased efficiency for memory-bound floating point algorithms 


Configure your next Cluster today! 
www. microway.com/quickquote 
508-746-7341 
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FasTree™ QDR InfiniBand Switches and HCAs 
4 45 TFLOPS » 36 Port, 40 Gb/s, Low Cost Fabrics 
» Compact, Scalable, Modular Architecture 
» Ideal for Building Expandable Clusters and Fabrics 
> MPI Link-Checker™ and InfiniScope™ Network Diagnostics 


FasTree 864 GB/sec 
Bi-sectional Bandwidth 


Achieve the Optimal Fabric Design for your Specific 
MPI Application with ProSim™ Fabric Simulator 

Now you can observe the real time communication coherency 
of your algorithms. Use this information to evaluate whether 
your codes have the potential to suffer from congestion. 
Feeding observed data into our IB fabric queuing-theory 
simulator lets you examine latency and bi-sectional bandwidth 
tradeoffs in fabric topologies. 
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Technology you can count on 


